Prefect(@PrefectIO) 's Twitter Profileg
Prefect

@PrefectIO

Modern workflow orchestration for data and ML engineers.

Get the code: https://t.co/QSWkoBOIBt
Chat in Slack: https://t.co/XpBioqgBty

ID:926480626823385088

linkhttps://www.prefect.io calendar_today03-11-2017 16:06:09

1,5K Tweets

6,1K Followers

152 Following

Prefect(@PrefectIO) 's Twitter Profile Photo

Think about the cost of data validation errors 🚧: at worst, they take down entire systems through runtime errors.

Pydantic is a framework for data validation to prevent downtime.

Read an overview of how to use Pydantic in tandem with Prefect:
vist.ly/xd7j

account_circle
Prefect(@PrefectIO) 's Twitter Profile Photo

Mike Grabbe (Principal Data Engineer) went from MS SQL Server jobs to scalable Python orchestration to unblock his company's data science team.

Come to ODSC in Boston April 23rd to find out how he did it with Prefect!

Find out more here πŸ‘‡
vist.ly/x4j9

Mike Grabbe (Principal Data Engineer) went from MS SQL Server jobs to scalable Python orchestration to unblock his company's data science team. Come to ODSC in Boston April 23rd to find out how he did it with Prefect! Find out more here πŸ‘‡ vist.ly/x4j9
account_circle
Prefect(@PrefectIO) 's Twitter Profile Photo

If you have code that:

πŸ›£οΈ Is used as a routing mechanism
πŸ€– Unifies remote systems
🚧 Relies on systems with transient issues

That is glue code. Instead of deploying brittle code, incorporate it as part of your core workflows with Prefect.

Read how πŸ‘‡
vist.ly/vmrz

account_circle
Prefect(@PrefectIO) 's Twitter Profile Photo

Need a reason to come to Boston besides the amazing bakeries in the North End?

Join us at Open Data Science's Data Engineering Summit on Wed 4/24 at 11am to hear from Bill Palombi and Jeff Hale on managing data pipelines like a platform.

Sign up today!
vist.ly/v4j2

Need a reason to come to Boston besides the amazing bakeries in the North End? Join us at @_odsc's Data Engineering Summit on Wed 4/24 at 11am to hear from @BillPalombi and @discdiver on managing data pipelines like a platform. Sign up today! vist.ly/v4j2
account_circle
Prefect(@PrefectIO) 's Twitter Profile Photo

Prefect will be in Boston April 23-25 for ODSC East (by Open Data Science)!

Chat with us at booth #17, hear about how to successfully build a self serve data platform from our team and from a user's perspective.

Register here and join us ➑️ vist.ly/tr46

Prefect will be in Boston April 23-25 for ODSC East (by @_odsc)! Chat with us at booth #17, hear about how to successfully build a self serve data platform from our team and from a user's perspective. Register here and join us ➑️ vist.ly/tr46
account_circle
Prefect(@PrefectIO) 's Twitter Profile Photo

Want to schedule checks for web vulnerability scans? Do so with Prefect.

Check out Oussama's full code below. Copy the code, pass in your custom domain, and schedule daily πŸ‘‡

vist.ly/td2g

Want to schedule checks for web vulnerability scans? Do so with Prefect. Check out Oussama's full code below. Copy the code, pass in your custom domain, and schedule daily πŸ‘‡ vist.ly/td2g
account_circle
Prefect(@PrefectIO) 's Twitter Profile Photo

Prefect's workflow metrics got more performant. How? Being backed by ClickHouse πŸƒ

Last week, Adam Azzam presented at the Clickhouse meetup (hosted by Ramp) about our swiss-army knife for data engineers: events.

πŸ‘‚ Listen to the full talk here:
vist.ly/t73c

Prefect's workflow metrics got more performant. How? Being backed by @ClickHouseDB πŸƒ Last week, @AAAzzam presented at the Clickhouse meetup (hosted by @tryramp) about our swiss-army knife for data engineers: events. πŸ‘‚ Listen to the full talk here: vist.ly/t73c
account_circle
Prefect(@PrefectIO) 's Twitter Profile Photo

You have data pipelines that need to be monitored so you stand up alerting infra. But then that system goes down. Now what?

We built observability into Prefect to manage this pain point for data pipelines and workflows. Read through the best practicesπŸ‘‡

vist.ly/s7j9

account_circle
Prefect(@PrefectIO) 's Twitter Profile Photo

Are you sick of a Status field showing up as either β€œFulfilled” or β€œFulfillment” depending on the source? If so, you need enum validation.

At Prefect, we ❀️ Pydantic. In this iteration, we explore enums and how they can be used for better data quality.

vist.ly/38z4x

account_circle
Prefect(@PrefectIO) 's Twitter Profile Photo

Ever find hidden dependencies for your dbt models? Use Prefect with and to:

β§― Get reliability with central logs
πŸ’²Find your least timely runs through Prefect's metrics
πŸ”œ Trigger models through APIs when needed

Read our guide πŸ‘‡
vist.ly/37hzh

account_circle