Know what each pipeline costs to run
Cost is a property of data work, so Synchronoid tracks it per pipeline, asset and source. See request counts against provider quotas, compute minutes and trends, and set budgets with alerts.
Example workspace data.
Attribute cost to the thing that caused it
A single total tells you nothing. Break it down by pipeline to find the expensive one, by asset to find the wasteful step, and by source to see which provider consumes your request quota.
- Compute minutes and step-runs per pipeline and asset.
- Requests per source, compared with its rate limit and quota.
- Month-over-month trends and the runs behind a spike.
| Pipeline | Step-runs | Compute min | Requests |
|---|---|---|---|
| companies_current | 62,400 | 1,420 | 480k |
| listings_sync | 71,900 | 1,610 | 520k |
| meter_readings | 38,200 | 760 | 140k |
| enrich_geo | 11,500 | 150 | 60k |
Requests against limits, per source
Providers charge or block by request. Because Synchronoid shares one budget per source, it can show you exactly how much of a quota is used, and by which pipelines.
Requests today
No surprises at the end of the month
Budgets
Set limits on step-runs, compute minutes or requests for a workspace, project, pipeline or source.
Threshold alerts
Get a Slack, PagerDuty or email alert at 80 percent and again at 100 percent, with the top contributors listed.
Guard rails
Optionally pause a pipeline when it passes its budget, instead of finding out from an invoice. Light steps keep the baseline low.
Ready to stop babysitting pipelines?
Synchronoid is in private beta. Tell us about your data and we will get you a workspace.