Getting Started with FME Flow
Getting Started with FME Flow
A Beginner's Guide to Automating Spatial
Data Workflows
If you've ever worked with
spatial data, you know that getting data from point A to point B in the right
format, with the right schema, at the right time can be surprisingly complex.
That's where FME comes in. And
specifically, FME Flow takes it a step further allowing you to
automate, schedule, and share those workflows across your entire organisation.
This blog is for beginners who are curious about FME Flow: what it is, how it differs from FME Form, how it's set up, and how you can start using it in the real world.
1. What is FME Flow?
FME Flow (previously
known as FME Server) is a web-based platform that lets you run, schedule,
and share FME workspaces as automated services without needing to open
the desktop application.
Think of it as the engine room
that keeps your data pipelines running in the background 24/7.
At its core, FME Flow lets you:
•
Publish workspaces built in FME Form to a central
server
•
Trigger those workspaces manually, on a schedule, or
via real-time events
•
Expose workspaces as self-serve web services for
non-technical users
• Monitor jobs, handle failures, and manage output delivery all from a browser
Whether you're a GIS analyst, data engineer, or IT architect, FME Flow transforms one-off data transformations into repeatable, enterprise-grade workflows.
2. FME Flow vs FME Form What's the Difference?
A common source of confusion is
understanding how FME Flow and FME Form relate to each other.
Here's a simple way to think
about it:
|
Feature |
FME Form |
FME Flow |
|
What is it? |
Desktop application (formerly FME Desktop) |
Web-based server platform (formerly FME Server) |
|
Primary use |
Build and test data transformation workspaces |
Deploy, automate, and share those workspaces |
|
Who uses it? |
GIS analysts, data engineers |
IT teams, end-users, automated systems |
|
Runs on |
Your local machine |
On-premise server or cloud |
|
Needs the other? |
Can run standalone |
Requires workspaces built in FME Form |
👉 You build workflows in FME Form and run them in FME Flow.
3. FME Flow Architecture The Big Picture
You don't need to be a system
administrator to understand FME Flow architecture, but a basic mental model
will help you troubleshoot and communicate more effectively.
FME Flow has three main layers.
FME Flow Web Application
This is the browser-based
interface where administrators and users interact with the platform.
From here you can:
•
Publish workspaces
•
View job history
•
Manage schedules
•
Monitor running jobs
• Create self-serve portals
FME Flow Core
The Core is the brain of FME
Flow.
It handles:
•
Job queuing
•
Licensing
•
Security
• Workflow orchestration
When you trigger a workspace via a schedule, API call, or button click the Core decides which engine should run it.
FME Engines
Engines are the processing units
that execute workspaces.
Example:
•
1 Engine → 1 job at a time
• 4 Engines → 4 jobs running simultaneously
Engines can run:
•
On the same server
•
On distributed servers
• In cloud environments
Deployment options include:
•
On-Premise installation
•
FME Flow Hosted (cloud managed by Safe Software)
• Container deployment using Docker or Kubernetes
4. Running & Scheduling Workspaces
Once you've built a workspace in
FME Form and published it to FME Flow, running it is straightforward.
Running a Workspace Manually
1.
Navigate to Run Workspace
2.
Select your repository and workspace
3.
Fill in any published parameters
4. Click Run
You will see real-time logs and
a job summary when the process completes.
Scheduling a Workspace
Automating workflows on a
schedule is one of FME Flow's most powerful features.
Under Automations → Schedules,
you can configure:
•
One-time runs
•
Recurring jobs
•
Cron-based schedules
• Email or webhook notifications on success or failure
Example:
•
Run a job every weekday at 6:00 AM
• Run a migration workflow every Sunday night
Automations & Event-Driven Triggers
Beyond schedules, FME Flow
supports event-driven automation.
You can trigger workflows when:
•
A new file arrives in a watched folder or cloud bucket
•
An email or webhook is received
•
Another workspace finishes
• A database record is updated
This enables near real-time data pipelines, not just batch processing.
5. Real-World Use Cases (GIS & Utilities)
FME Flow is widely used in GIS,
utilities, transportation, and government organisations.
Here are a few practical examples.
Automated Data Migration QA
In ArcGIS Utility Network
migration projects, FME Flow can run QA validation workflows nightly, checking:
•
Attribute population
•
Domain compliance
•
Null value percentages
• Data consistency
Reports can be automatically emailed to project managers each morning.
Self-Serve Data Extraction
Field teams often require
on-demand GIS data exports such as:
•
Shapefile
•
KML
• CSV
Instead of manual requests to
the GIS team, FME Flow can provide a self-service portal where users:
1.
Select an area of interest
2.
Choose a data format
3. Download the processed dataset automatically
Real-Time Integration
Utilities integrating GIS with
asset management platforms such as IBM Maximo or SAP can use FME Flow to
synchronize data between systems.
This ensures spatial assets and maintenance records remain consistent.
Scheduled Data Synchronisation
Organizations maintaining
multiple systems such as:
•
Enterprise Geodatabases
•
Data warehouses
•
Web services
• Analytics platforms
can use FME Flow to run overnight synchronization pipelines that transform and distribute clean data across systems.
Getting Started Your Next Steps
FME Flow may seem like a complex
platform at first, but the learning curve becomes much easier after running
your first automated workflow.
Recommended path for
beginners:
5.
Download a trial of FME Form
6.
Build a simple workspace
7.
Sign up for an FME Flow Hosted trial from Safe Software
8.
Publish the workspace
9.
Run it from the web interface
10. Create
a schedule or folder-watch automation
11. Explore tutorials and community examples
Conclusion
FME Flow is more than just a
data automation tool it is a platform for building reliable, scalable data
pipelines.
Whether you're:
•
Automating nightly GIS exports
•
Running QA checks on spatial datasets
• Integrating enterprise systems
FME Flow provides the
infrastructure to run those processes reliably and repeatedly without manual
intervention.
Written for FME beginners | Safe
Software FME Platform
Comments
Post a Comment