Neil Ramaswamy(@entersudonym) 's Twitter Profileg
Neil Ramaswamy

@entersudonym

performance and usability on Apache Spark Structured Streaming @Databricks; previously @BrownUniversity

ID:1217721735518113793

calendar_today16-01-2020 08:14:41

199 Tweets

281 Followers

151 Following

Neil Ramaswamy(@entersudonym) 's Twitter Profile Photo

Fun Scala riddle that cost me a lot of time:

I have a collections.mutable.Set called `s`. When I print `s`, I get back `Set(0, 1)`. When I print `s.toSeq`, I get back `Seq(0, 1)`. When I print `s.toSeq.size`, I get back 2.

What's the result of `s.size`?

account_circle
Neil Ramaswamy(@entersudonym) 's Twitter Profile Photo

The world is becoming real-time. A batch job on a cron *will* burn you.

Watch the video to deep-dive into how real-time SQL engines function correctly and with low-latency!

account_circle
Neil Ramaswamy(@entersudonym) 's Twitter Profile Photo

realizing streaming was the generalization of batch sparks the same joy as learning integration was the generalization of finding areas of shapes

you too can have this joy. but you must want it

account_circle
Neil Ramaswamy(@entersudonym) 's Twitter Profile Photo

Thanks Phil Eaton for organizing this! I'm so excited to share (and evangelize) streaming systems.

If you couldn't get a spot/aren't in New York, DM me. I'd be happy to give a few Zoom one-on-ones of the presentation, as long as you give feedback :)

account_circle
Neil Ramaswamy(@entersudonym) 's Twitter Profile Photo

Sigh, my wording was poor, but I was trying to ask if people wanted to help me *write* open-source projects.

But since there's so much demand... let me see if I can open source the projects I wrote for the Brown CS course (they might not be in use any longer). Stay tuned!

account_circle