What’s maybe more exciting, though, is something Databricks calls Project Lightspeed, which the company describes as the next generation of the Spark streaming engine.

The Apache Spark community has improved support for Python to such a great degree over the past few years that Python is now a “first-class” language, and no longer a “clunky” add-on as it once was, ...

Apache Spark 3.0 is now here, and it’s bringing a host of enhancements across its diverse range of capabilities. The headliner is an big bump in performance for the SQL engine and better coverage of ...

Databricks Cloud will provide Spark-based streaming analysis as a service Taking on Google, Databricks plans to offer its own cloud service for analyzing live data streams, one based on the Apache ...

Still, Databricks’ announcements today failed to address its in-memory data processing capabilities, which Mueller said was Spark’s biggest strength but also its biggest weakness.

“Spark is a game changer,” said Paco Nathan, Databricks training director and data veteran. “It’s allowing more of the business customer inside of an organization to get hands-on with the ...

Taking on Google, Databricks plans to offer its own cloud service for analyzing live data streams, one based on the Apache Spark software.