#  @matei_zaharia Matei Zaharia Matei Zaharia posts on X about databricks, ai, data ai summit, compound the most. They currently have [------] followers and [---] posts still getting attention that total [-----] engagements in the last [--] hours. ### Engagements: [-----] [#](/creator/twitter::201130645/interactions)  - [--] Week [-----] -72% - [--] Month [------] -38% - [--] Months [-------] +237% - [--] Year [-------] -51% ### Mentions: [--] [#](/creator/twitter::201130645/posts_active)  - [--] Month [--] -78% - [--] Months [--] -7.10% - [--] Year [--] -53% ### Followers: [------] [#](/creator/twitter::201130645/followers)  - [--] Week [------] +0.13% - [--] Month [------] +0.59% - [--] Months [------] +5% - [--] Year [------] +8.80% ### CreatorRank: [---------] [#](/creator/twitter::201130645/influencer_rank)  ### Social Influence **Social category influence** [technology brands](/list/technology-brands) [events](/list/events) [stocks](/list/stocks) [finance](/list/finance) [travel destinations](/list/travel-destinations) [fashion brands](/list/fashion-brands) [countries](/list/countries) **Social topic influence** [databricks](/topic/databricks), [ai](/topic/ai), [data ai summit](/topic/data-ai-summit), [compound](/topic/compound), [build](/topic/build), [llm](/topic/llm), [systems](/topic/systems), [agentic](/topic/agentic), [the first](/topic/the-first), [san jose](/topic/san-jose) **Top accounts mentioned or mentioned by** [@databricks](/creator/undefined) [@dataaisummit](/creator/undefined) [@dbrxmosaicai](/creator/undefined) [@mlflow](/creator/undefined) [@aidotengineer](/creator/undefined) [@apachespark](/creator/undefined) [@aiatmeta](/creator/undefined) [@caisconf](/creator/undefined) [@chenlingjiao](/creator/undefined) [@lmthang](/creator/undefined) [@lateinteraction](/creator/undefined) [@naveengrao](/creator/undefined) [@jefrankle](/creator/undefined) [@neondatabase](/creator/undefined) [@gartnerinc](/creator/undefined) [@dawnsongtweets](/creator/undefined) [@istoica05](/creator/undefined) [@monicaslam](/creator/undefined) [@deltalakeoss](/creator/undefined) [@googlecloud](/creator/undefined) **Top assets mentioned** [Alphabet Inc Class A (GOOGL)](/topic/$googl) [Cloudflare, Inc. (NET)](/topic/cloudflare) [ACM Research, Inc. Class A Common Stock (ACMR)](/topic/$acmr) [IBM (IBM)](/topic/ibm) [INTESA SANPAOLO (ISNPY)](/topic/intesa-sanpaolo) [Dell Technologies, Inc. (DELL)](/topic/dell) [Microsoft Corp. (MSFT)](/topic/microsoft) ### Top Social Posts Top posts by engagements in the last [--] hours "Super excited to announce MLflow a new open source Machine Learning platform from Databricks to manage the complete machine learning lifecycle: https://databricks.com/blog/2018/06/05/introducing-mlflow-an-open-source-machine-learning-platform.html https://databricks.com/blog/2018/06/05/introducing-mlflow-an-open-source-machine-learning-platform.html" [X Link](https://x.com/matei_zaharia/status/1004061474183045121) 2018-06-05T18:04Z 46.2K followers, [---] engagements "@cutting Just means that even though it can talk to Databricks cloud product additional terms of use apply to that product. But you dont have to use that part" [X Link](https://x.com/matei_zaharia/status/1004187339277590529) 2018-06-06T02:24Z 46.2K followers, [--] engagements "I gave a keynote at @ACMSoCC about lessons from building a large-scale cloud service at @Databricks. Did you know that Databricks runs millions of VMs/day to process exabytes of data with [---] engineers Slides here: https://www.slideshare.net/matei/lessons-from-largescale-cloud-software-at-databricks https://www.slideshare.net/matei/lessons-from-largescale-cloud-software-at-databricks" [X Link](https://x.com/matei_zaharia/status/1197672071951613952) 2019-11-22T00:24Z 45.3K followers, [---] engagements "#DataAISummit Call for Presentations ends Jan [--] Submit your case studies research or best practices around #Lakehouse MLOps streaming and data. Last year's event included [-----] data experts. http://dbricks.co/3Wh1Mx6 http://dbricks.co/3Wh1Mx6" [X Link](https://x.com/matei_zaharia/status/1613232165260775425) 2023-01-11T17:51Z 46.1K followers, 15.9K engagements "Want to build your own chat AI from scratch We're launching a Building LLMs course at @Data_AI_Summit to teach everyone how to build a Dolly clone: Tiny model big attitude for anyone. #DemocratizeAI https://www.databricks.com/dataaisummit https://www.databricks.com/dataaisummit" [X Link](https://x.com/matei_zaharia/status/1641860416753242112) 2023-03-31T17:50Z 46K followers, 28.5K engagements "Some nice goodies for in-person attendees of @Data_AI_Summit this year. Register here: https://www.databricks.com/dataaisummit/ https://www.databricks.com/dataaisummit/" [X Link](https://x.com/matei_zaharia/status/1650579051902558209) 2023-04-24T19:14Z 46K followers, 10.9K engagements "Really excited to have @lqiao as a keynote speaker at @Data_AI_Summit: 💪 Co-creator of @PyTorch 🌟 Co-founder and CEO Fireworks 🧠 #AI expert Ph.D. Hear from her and other data and AI leaders this June: https://www.databricks.com/dataaisummit/ https://www.databricks.com/dataaisummit/" [X Link](https://x.com/matei_zaharia/status/1652542165237768192) 2023-04-30T05:15Z 46K followers, [----] engagements "Submit your talks to #DataAISummit now to reach tens of thousands of practitioners and execs The conference will be in San Francisco next June. Calling all Data + AI Innovators https://t.co/0k6bivJJGE #DataAISummit [----] is your chance to showcase your work to 70000+ peers 🌎 Share insights on: ✔ Real-time data streaming ✔ Deep learning & ML ✔ BI and SQL analytics ✔ & more https://t.co/45sH1m4rju Calling all Data + AI Innovators https://t.co/0k6bivJJGE #DataAISummit [----] is your chance to showcase your work to 70000+ peers 🌎 Share insights on: ✔ Real-time data streaming ✔ Deep learning & ML ✔" [X Link](https://x.com/matei_zaharia/status/1862206532206891343) 2024-11-28T18:46Z 46K followers, [----] engagements "@PaulLockettkpb @databricks Thanks fixed them" [X Link](https://x.com/matei_zaharia/status/1932879139050303638) 2025-06-11T19:14Z 45.4K followers, [--] engagements "Prompt optimization is becoming a powerful technique for improving AI that can even beat SFT Here are some of our research results with GEPA at Databricks in difficult Agent Bricks info extraction tasks. We can match the best models at 90x lower cost or improve them by 6%" [X Link](https://x.com/matei_zaharia/status/1971061853385261247) 2025-09-25T03:59Z 45.4K followers, 106.2K engagements "We've invested a lot in agent evaluation in MLflow and made it super easy to get high quality judges. Our new make_judge judges can take declarative instructions analyze entire traces from any agent framework and align their ratings with human feedback. https://mlflow.org/blog/custom-llm-judges-make-judge https://mlflow.org/blog/custom-llm-judges-make-judge" [X Link](https://x.com/matei_zaharia/status/1976075557625532595) 2025-10-09T00:01Z 45.6K followers, 11.7K engagements "My team is hiring AI research interns for summer [----] at Databricks Join us to learn about AI use cases at thousands of companies and contribute to making it easier for anyone to build specialized AI agents and models for difficult tasks" [X Link](https://x.com/matei_zaharia/status/1979250571262783659) 2025-10-17T18:18Z 45.9K followers, 121.1K engagements "Specific focus areas include scalable RL training multimodal models information retrieval evaluation and coding and data science agents. Apply here: https://www.databricks.com/company/careers/university-recruiting/phd-genai-research-scientist-intern-7011263002 https://www.databricks.com/company/careers/university-recruiting/phd-genai-research-scientist-intern-7011263002" [X Link](https://x.com/matei_zaharia/status/1979250573401821318) 2025-10-17T18:18Z 45.3K followers, [----] engagements "Fine-tuned (PEFT/LoRA) models can greatly improve quality but serving them can be challenging due to both numerical and performance issues. Our team has done amazing work to get up to 2x higher throughput and 2-3% better quality than open source engines: https://www.databricks.com/blog/fast-peft-serving-scale https://www.databricks.com/blog/fast-peft-serving-scale" [X Link](https://x.com/matei_zaharia/status/1980761499103818227) 2025-10-21T22:21Z 45.4K followers, [----] engagements "This is a big deal -- ingest data into any lakehouse table with no infra setup just calling a REST API. Simple efficient and powerful. Announcing Public Preview of Zerobus Ingest part of Lakeflow Connect: Push event data directly into your lakehouseno message bus required Simplified ingestion. Reduced latency. Built for scale. - Up to [---] MB/sec per connection - Latency as low as [--] seconds - Native Delta + https://t.co/ozlYjgBfKo Announcing Public Preview of Zerobus Ingest part of Lakeflow Connect: Push event data directly into your lakehouseno message bus required Simplified ingestion." [X Link](https://x.com/matei_zaharia/status/1983986571058802960) 2025-10-30T19:57Z 45.4K followers, [----] engagements "Enterprise documents are very complex with tables headings figures etc and the new ai_parse_document identifies these components reliably and returns them in a JSON form for downstream apps/agents. Customers have been putting it to the test on some very tough datasets" [X Link](https://x.com/matei_zaharia/status/1988325179106406725) 2025-11-11T19:17Z 45.5K followers, [----] engagements "We also made it super easy to use from SQL or Apache Spark. Just call ai_parse_document and we automatically handle batch execution at scale. Docs here: https://docs.databricks.com/aws/en/sql/language-manual/functions/ai_parse_document https://docs.databricks.com/aws/en/sql/language-manual/functions/ai_parse_document" [X Link](https://x.com/matei_zaharia/status/1988325182013079859) 2025-11-11T19:17Z 45.5K followers, [----] engagements "@tasso @databricks Super excited to work together Tasso" [X Link](https://x.com/matei_zaharia/status/1988439657353458104) 2025-11-12T02:52Z 45.5K followers, [---] engagements "Congrats to all the database product teams at Databricks for this great recognition Were proud to share that Databricks has been named a Leader in the [----] @Gartner_inc Magic Quadrant for Cloud Database Management Systems for the fifth year in a row The Databricks Platform enables everyone in your organization to use data and AI. New innovations like Agent https://t.co/IwAXTdPEcD Were proud to share that Databricks has been named a Leader in the [----] @Gartner_inc Magic Quadrant for Cloud Database Management Systems for the fifth year in a row The Databricks Platform enables everyone in your" [X Link](https://x.com/matei_zaharia/status/1991955302879752382) 2025-11-21T19:42Z 45.6K followers, [----] engagements "If you're at #NeurIPS check out Erich Elsen's talk at 5:15 today on a new AI benchmark competition we created at @Databricks for economically valuable tasks where frontier model still struggle significantly. https://neurips.cc/virtual/2025/loc/san-diego/talk/127768 https://neurips.cc/virtual/2025/loc/san-diego/talk/127768" [X Link](https://x.com/matei_zaharia/status/1995897763247395047) 2025-12-02T16:48Z 45.8K followers, [----] engagements "LLMs are claimed to reach PhD intelligence but still fail mundane tasks. To understand this challenge Databricks launched OfficeQA a benchmark of useful tasks that require reliability&diligence not specialized knowledge. We're also doing a competition https://www.databricks.com/blog/introducing-officeqa-benchmark-end-to-end-grounded-reasoning https://www.databricks.com/blog/introducing-officeqa-benchmark-end-to-end-grounded-reasoning" [X Link](https://x.com/matei_zaharia/status/1998522148777083116) 2025-12-09T22:36Z 45.9K followers, 26K engagements "Great to see GPT-5.2 come out today We also found it to do better than past frontier models on OfficeQA though there is still a lot of headroom for AI to do well on this benchmark. Were excited to share that our customers have day-one access to OpenAI GPT-5.2 on Databricks GPT-5.2 delivers strong gains on OfficeQA our benchmark for grounded enterprise reasoning and is now available on our platform with native Response API support. Paired with Agent https://t.co/45C0mr8VVv Were excited to share that our customers have day-one access to OpenAI GPT-5.2 on Databricks GPT-5.2 delivers strong gains" [X Link](https://x.com/matei_zaharia/status/1999190301727199292) 2025-12-11T18:51Z 45.9K followers, 14.5K engagements "People often ask me why we think Databricks can succeed in new areas we expand to. This is the recipe why: we build stellar teams in areas where we think we can greatly improve on the status quo. Lakehouse was one Lakebase is next but there's more coming especially in AI. We disclosed today as part of our Series L that our 4-yr old data warehousing business is now $1B revenue run rate. This is to the best of my knowledge the fastest to $1B DW product in the industry. How did we do it and whats next The conventional wisdom is that it would We disclosed today as part of our Series L that our" [X Link](https://x.com/matei_zaharia/status/2001166538888417714) 2025-12-17T05:44Z 46K followers, 37.6K engagements "I'm thrilled to be co-organizing a new ACM research Conference on Agentic & AI Systems (CAIS) this spring It's the first conference focused solely on this field. 📍San Jose May 26-29 [----] 🗓Paper deadline Feb 27th Follow @CAISconf for updates http://caisconf.org http://caisconf.org" [X Link](https://x.com/matei_zaharia/status/2003523589161800044) 2025-12-23T17:50Z 46.1K followers, 34.8K engagements "CAIS is organized by a great steering and organizing committee including @heathercmiller @jaredq_ @deeptir18 @ChenLingjiao @JeffDean @lmthang @gneubig @pirroh @dawnsongtweets @istoica05 @lateinteraction @MonicaSLam @ChrisGPotts @NaveenGRao. Submit your papers & workshops in Feb" [X Link](https://x.com/matei_zaharia/status/2003523591816855742) 2025-12-23T17:50Z 45.9K followers, [----] engagements "Dicer is a statue of the art reliable autosharder that can power a wide range of stateful services. You can find it on GitHub at https://github.com/databricks/dicer https://github.com/databricks/dicer" [X Link](https://x.com/matei_zaharia/status/2011226521801720295) 2026-01-13T23:59Z 46.1K followers, [----] engagements "Agent memory is a simple and powerful way to do continual learning With the new MemAlign method from Databricks Research we can build better LLM judges from examples of human ratings and they scale with more data. Now in Databricks and @MLflow. https://www.databricks.com/blog/memalign-building-better-llm-judges-human-feedback-scalable-memory https://www.databricks.com/blog/memalign-building-better-llm-judges-human-feedback-scalable-memory" [X Link](https://x.com/anyuser/status/2019107960006537635) 2026-02-04T17:57Z 46.4K followers, 17.7K engagements "At Databricks we've built an awesome model training and tuning stack. We now used it to release DBRX the best open source LLM on standard benchmarks to date exceeding GPT-3.5 while running 2x faster than Llama-70B. https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm" [X Link](https://x.com/matei_zaharia/status/1772972271721763199) 2024-03-27T13:01Z 46.4K followers, 129.8K engagements "Really cool -- looks like system design and prompts can have more impact than foundation model weight training past some point. Our IMO gold medal-winning AI pipeline is now model-agnostic. 🥇 What worked for Gemini [---] Pro now gets the same 5/6 score with GPT-5 & Grok4. This confirms the power of our verification-and-refinement pipeline to improve base model capabilities. The new code & results are Our IMO gold medal-winning AI pipeline is now model-agnostic. 🥇 What worked for Gemini [---] Pro now gets the same 5/6 score with GPT-5 & Grok4. This confirms the power of our" [X Link](https://x.com/matei_zaharia/status/1960795957161005293) 2025-08-27T20:06Z 46.4K followers, [----] engagements "If you're running agents in production consider taking this short survey from my research group We're collaborating with IBM Stanford UIUC Intesa Sanpaolo and others to better understand the challenges in building agents. It only takes [--] minutes: https://agents-survey.github.io/AI-Agent-Survey/participate/ https://agents-survey.github.io/AI-Agent-Survey/participate/" [X Link](https://x.com/anyuser/status/1960808329942589876) 2025-08-27T20:55Z 46.4K followers, 35.4K engagements "Great new capability in Databricks powered by our AI research team We trained a document parsing system that delivers leading quality at 3-5x lower cost and outperforms leading VLMs like GPT-5 and Claude. This is critical to connect AI to so many kinds of data. 80% of enterprise data is unstructured locked in PDFs reports and diagrams that traditional tools cant parse or govern. Introducing ai_parse_document state-of-the-art document intelligence on Databricks. With a single SQL command teams can now turn any document into https://t.co/UNNyWqPJoo 80% of enterprise data is unstructured locked" [X Link](https://x.com/matei_zaharia/status/1988325177193885885) 2025-11-11T19:17Z 46.2K followers, 33.8K engagements "Super excited that were open sourcing the Dicer autosharder Its become a critical piece of infrastructure in Databricks thats made many of our systems more scalable and reliable and its powered by really cool systems work. https://www.databricks.com/blog/open-sourcing-dicer-databricks-auto-sharder https://www.databricks.com/blog/open-sourcing-dicer-databricks-auto-sharder" [X Link](https://x.com/matei_zaharia/status/2011226518878634499) 2026-01-13T23:59Z 46.4K followers, 17.7K engagements "Lakebase is GA We think this is going to make it radically simpler and more reliable to work with online databases. You can instantly branch your DB take snapshots roll back to a point in time or create a copy for offline analysis whether it's humans or AI doing the work. Operational databases have long relied on tightly coupled compute and storage. This architecture creates resource contention and pushes teams to manage infrastructure rather than build. As applications become more real time and automated the transactional layer needs to adapt. https://t.co/BE2TAysLrX Operational databases" [X Link](https://x.com/anyuser/status/2018828652431933839) 2026-02-03T23:27Z 46.4K followers, 13.1K engagements "Agentic Data Quality Monitoring is now in public preview on @Databricks powered by Unity Catalog This next generation of monitoring looks at how your data is used to automatically flag the most important issues without needing manual rules & thresholds. https://www.databricks.com/blog/data-quality-monitoring-scale-agentic-ai https://www.databricks.com/blog/data-quality-monitoring-scale-agentic-ai" [X Link](https://x.com/anyuser/status/2019461534695739578) 2026-02-05T17:22Z 46.4K followers, [----] engagements "ACM CAIS is a the first research conference focused on agentic and AI systems and will run in San Jose this year. The deadline is coming up Feb 27th submit your papers here: https://www.caisconf.org/ https://www.caisconf.org/" [X Link](https://x.com/anyuser/status/2019622416440574397) 2026-02-06T04:01Z 46.4K followers, [----] engagements "Very excited about this opportunity for CAIS paper authors to also present at @aiDotEngineer World's Fair Excited to share that this years @aiDotEngineer Worlds Fair will be the first to offer industry spotlight awards for peer reviewed papers and we are setting aside poster sessions to feature the best industry-impacting research of [----]. Please submit and we very much look https://t.co/4SuDQRN2mk Excited to share that this years @aiDotEngineer Worlds Fair will be the first to offer industry spotlight awards for peer reviewed papers and we are setting aside poster sessions to feature the" [X Link](https://x.com/anyuser/status/2021293888389181733) 2026-02-10T18:43Z 46.4K followers, [----] engagements "Spark + AI Summit [----] videos are now up at https://databricks.com/sparkaisummit/sessionseventName=Summit%202018 https://databricks.com/sparkaisummit/sessionseventName=Summit%202018" [X Link](https://x.com/matei_zaharia/status/1009846579665104896) 2018-06-21T17:12Z 42.2K followers, [---] engagements "Slides from our first #MLflow meetup last week: https://www.slideshare.net/databricks/introduction-fo-mlflow https://www.slideshare.net/databricks/introduction-fo-mlflow" [X Link](https://x.com/matei_zaharia/status/1013093021179498503) 2018-06-30T16:12Z 42.3K followers, [---] engagements "Databricks Ion Stoica presenting the unified analytics platform for genomics to kick off the second day of #SparkAISummit London" [X Link](https://x.com/matei_zaharia/status/1047762243344064513) 2018-10-04T08:15Z 42.3K followers, [--] engagements "#ApacheSpark [---] is out today This release has tons of new features including barrier execution mode for ML applications higher-order functions in SQL optional eager evaluation for previewing DataFrames in Jupyter Scala [----] support and more. https://spark.apache.org/releases/spark-release-2-4-0.html https://spark.apache.org/releases/spark-release-2-4-0.html" [X Link](https://x.com/matei_zaharia/status/1060613705258258432) 2018-11-08T19:23Z 42.3K followers, [---] engagements "Super excited to have Katie Bouman speaking at #SparkAISummitEurope this October We're pleased to announce that Katie Bouman will be a keynote speaker at #SparkAISummit Europe Register now to hear how she developed a #machinelearning algorithm to capture the first picture of a black hole: https://t.co/jj9iG9wld4 https://t.co/8Ke2m3UjjW We're pleased to announce that Katie Bouman will be a keynote speaker at #SparkAISummit Europe Register now to hear how she developed a #machinelearning algorithm to capture the first picture of a black hole: https://t.co/jj9iG9wld4 https://t.co/8Ke2m3UjjW" [X Link](https://x.com/matei_zaharia/status/1156602955618893825) 2019-07-31T16:30Z 42.3K followers, [--] engagements "Some fun with @Databricks interns at minigolf. Were hiring interns in both SF and Amsterdam for next year: https://databricks.com/company/careersgh_jid=4374189002 https://databricks.com/company/careersgh_jid=4374189002" [X Link](https://x.com/matei_zaharia/status/1157476072847368193) 2019-08-03T02:19Z 42.2K followers, [--] engagements "Nice case study from HyperloopOne about running pandas code on #ApacheSpark with the new Koalas library: No more complex rewrite into Spark DataFrames needed. https://databricks.com/blog/2019/08/22/guest-blog-how-virgin-hyperloop-one-reduced-processing-time-from-hours-to-minutes-with-koalas.html https://databricks.com/blog/2019/08/22/guest-blog-how-virgin-hyperloop-one-reduced-processing-time-from-hours-to-minutes-with-koalas.html" [X Link](https://x.com/matei_zaharia/status/1164632133685526528) 2019-08-22T20:15Z 42.2K followers, [--] engagements "I'm also excited to speak about #MLflow at the Data Engineering Meetup in Berlin on Oct 21st. Thanks @Zalando for hosting this event: https://www.meetup.com/Zalando-Tech-Events-Berlin/events/265207361/_xtd=gqFyqTE0OTEwODg4MqFwp2FuZHJvaWQ&from=ref https://www.meetup.com/Zalando-Tech-Events-Berlin/events/265207361/_xtd=gqFyqTE0OTEwODg4MqFwp2FuZHJvaWQ&from=ref" [X Link](https://x.com/matei_zaharia/status/1178558584017186816) 2019-09-30T06:33Z 42.3K followers, [--] engagements "Databricks is proud to be sponsoring the #MLSys research conference this year. Drop by our booth to hear about jobs building large-scale ML platforms -- we run ML and data workloads for over [----] customers processing exabytes of data per day" [X Link](https://x.com/matei_zaharia/status/1234583160920383496) 2020-03-02T20:55Z 42.2K followers, [--] engagements "One of my favorite features in the upcoming #ApacheSpark [---] is Adaptive Query Execution (AQE) which tunes number of reduce tasks join algorithms and skew joins automatically. Learn how it works and how it speeds up TPC-DS queries by up to 8x: https://databricks.com/blog/2020/05/29/adaptive-query-execution-speeding-up-spark-sql-at-runtime.html https://databricks.com/blog/2020/05/29/adaptive-query-execution-speeding-up-spark-sql-at-runtime.html" [X Link](https://x.com/matei_zaharia/status/1266437941288529921) 2020-05-29T18:35Z 42.2K followers, [---] engagements "#SparkAISummit will include some truly large-scale data and AI use cases. One highlight is this talk from Apple's Dom Brezinski on one of the earliest and largest uses of #DeltaLake processing 100s of TBs of network events / day for information security: https://databricks.com/session_na20/patterns-and-operational-insights-from-the-first-users-of-delta-lake https://databricks.com/session_na20/patterns-and-operational-insights-from-the-first-users-of-delta-lake" [X Link](https://x.com/matei_zaharia/status/1275132166863589376) 2020-06-22T18:22Z 42.3K followers, [--] engagements "Several cakes were harmed in the making of this conference Lesson #2 on running a virtual conference: Nail the transitions It's easy to hand the clicker to your peer onstage but we had to get creative with #SparkAISummit. Sharing a cake Snapping a finger There's no limit when you're sharing a virtual stage https://t.co/iIzkNB6Xbo Lesson #2 on running a virtual conference: Nail the transitions It's easy to hand the clicker to your peer onstage but we had to get creative with #SparkAISummit. Sharing a cake Snapping a finger There's no limit when you're sharing a virtual stage" [X Link](https://x.com/matei_zaharia/status/1281635367657943040) 2020-07-10T17:04Z 42.3K followers, [--] engagements "For @VLDB2020 we wrote a paper on @DeltaLakeOSS one of the most exciting new technologies from Databricks. By adding ACID transactions over cloud object stores we can provide data-warehouse-like capabilities & performance on low-cost HA cloud storage. https://databricks.com/wp-content/uploads/2020/08/p975-armbrust.pdf https://databricks.com/wp-content/uploads/2020/08/p975-armbrust.pdf" [X Link](https://x.com/matei_zaharia/status/1297228632859893763) 2020-08-22T17:46Z 44.8K followers, [---] engagements "Some nice ongoing work to make it easier to ship various kinds of #Python environments with @ApacheSpark applications as part of Project Zen: https://databricks.com/blog/2020/12/22/how-to-manage-python-dependencies-in-pyspark.html https://databricks.com/blog/2020/12/22/how-to-manage-python-dependencies-in-pyspark.html" [X Link](https://x.com/matei_zaharia/status/1341785551012319232) 2020-12-23T16:39Z 42.3K followers, [--] engagements "Starting soon Only [--] days left to register for our #MLOps virtual event Join us to learn about: 🖥 Best practices to operationalize #ML at scale 💪 Customer success stories 🙋 Live Q&A .and so much more https://t.co/DVupn6wCvz Only [--] days left to register for our #MLOps virtual event Join us to learn about: 🖥 Best practices to operationalize #ML at scale 💪 Customer success stories 🙋 Live Q&A .and so much more https://t.co/DVupn6wCvz" [X Link](https://x.com/matei_zaharia/status/1359188195242614785) 2021-02-09T17:11Z 42.3K followers, [--] engagements "Databricks is now available on @googlecloud We've also built great integrations with BigQuery Looker GCS and Google AI services across the product. Open #lakehouse platform meets open #cloud with unified data engineering data science and analytics. Learn more about Databricks on @GoogleCloud: https://t.co/2ACwHl2SCK https://t.co/MTI5SbWnRS Open #lakehouse platform meets open #cloud with unified data engineering data science and analytics. Learn more about Databricks on @GoogleCloud: https://t.co/2ACwHl2SCK https://t.co/MTI5SbWnRS" [X Link](https://x.com/matei_zaharia/status/1362059922838593538) 2021-02-17T15:22Z 42.3K followers, [---] engagements "There are a lot of nice updates to Structured Streaming in @ApacheSpark [---] including new types of stream-stream joins better UI easier SQL integration by registering streams as tables and better @ApacheKafka and file data sources: https://databricks.com/blog/2021/04/27/whats-new-in-apache-spark-3-1-release-for-structured-streaming.html https://databricks.com/blog/2021/04/27/whats-new-in-apache-spark-3-1-release-for-structured-streaming.html" [X Link](https://x.com/matei_zaharia/status/1387446818473054215) 2021-04-28T16:41Z 42.3K followers, [--] engagements "We're thrilled to launch #DeltaSharing an open protocol for secure data sharing between different computing platforms at #Data_AI_Summit today Databricks is working on this with a big ecosystem of partners including the top cloud BI and data vendors. https://databricks.com/blog/2021/05/26/introducing-delta-sharing-an-open-protocol-for-secure-data-sharing.html https://databricks.com/blog/2021/05/26/introducing-delta-sharing-an-open-protocol-for-secure-data-sharing.html" [X Link](https://x.com/matei_zaharia/status/1397585545849540612) 2021-05-26T16:08Z 42.3K followers, [---] engagements "Databricks just set a new record on the official TPC-DS data warehousing benchmark showing that a lakehouse system based on open data formats can outperform previous DW systems. Don't listen to folks who say open means bad performance https://databricks.com/blog/2021/11/02/databricks-sets-official-data-warehousing-performance-record.html https://databricks.com/blog/2021/11/02/databricks-sets-official-data-warehousing-performance-record.html" [X Link](https://x.com/matei_zaharia/status/1455571735420366849) 2021-11-02T16:25Z 42.2K followers, [---] engagements "Finally got to meet the cardboard cutout of me that someone put in the @Databricks Singapore office. It's a fun and fast-growing office #GovTechSTACK #DestinationLakehouse" [X Link](https://x.com/matei_zaharia/status/1592537231503560705) 2022-11-15T15:17Z 42.3K followers, [--] engagements "ChatGPT is super cool but it can still get facts very wrong like this example we used in [----] It even generates a second wrong fact (not named after governor). LLMs probably need to use tools like retrieval to avoid being BS-as-a-service. https://hai.stanford.edu/news/moderate-proposal-radically-better-ai-powered-web-search https://hai.stanford.edu/news/moderate-proposal-radically-better-ai-powered-web-search" [X Link](https://x.com/matei_zaharia/status/1598755260142874624) 2022-12-02T19:05Z 42.2K followers, [---] engagements "We've just launched a version of Dolly on HuggingFace with new examples showing its capabilities. This is all with just 50k training examples. Stay tuned for new versions with other datasets soon. https://huggingface.co/databricks/dolly-v1-6b https://huggingface.co/databricks/dolly-v1-6b" [X Link](https://x.com/matei_zaharia/status/1641471881743331328) 2023-03-30T16:06Z 42.3K followers, 107.7K engagements "Very cool to see Dolly-v2 hit #1 trending on HuggingFace Hub today. Stay tuned for a lot more LLM infra coming from Databricks soon. And register for our @Data_AI_Summit conference to hear the biggest things as they launch -- online attendance is free" [X Link](https://x.com/matei_zaharia/status/1646385588092932097) 2023-04-13T05:31Z 42.3K followers, 48.3K engagements "Want to build your own conversational AI from open datasets and your own data Join this free webinar on April 25th with some of the Dolly authors: https://www.databricks.com/resources/webinar/build-your-own-large-language-model-dolly https://www.databricks.com/resources/webinar/build-your-own-large-language-model-dolly" [X Link](https://x.com/matei_zaharia/status/1646942487230160896) 2023-04-14T18:24Z 42.3K followers, 27.6K engagements "Databricks just published our #StateofDataAI report with interesting trends at our enterprise customers: [--]. Adoption of LLMs is booming with use of SaaS LLM APIs exploding since #ChatGPT launched but the largest use (and growth) still in custom LLMs. https://www.databricks.com/discover/state-of-data-ai https://www.databricks.com/discover/state-of-data-ai" [X Link](https://x.com/matei_zaharia/status/1661044743416184833) 2023-05-23T16:21Z 42K followers, 70.2K engagements "I'm thrilled to host a panel with four amazing AI faculty at @Data_AI_Summit: Daniela Rus @dawnsongtweets @mcarbin and @percyliang. They're leading some of the top labs in AI that have enabled today's systems so I'm excited to see what they say about the future" [X Link](https://x.com/matei_zaharia/status/1664403576423346178) 2023-06-01T22:48Z 42K followers, [----] engagements "#MLflow [---] was released today with new tools for LLMOps including visual comparison and programmatic evaluation. We also added a new Evaluation Datasets concept useful in any kind of MLOps workflow. Check it out: https://www.databricks.com/blog/announcing-mlflow-24-llmops-tools-robust-model-evaluation https://www.databricks.com/blog/announcing-mlflow-24-llmops-tools-robust-model-evaluation" [X Link](https://x.com/matei_zaharia/status/1666587579398131712) 2023-06-07T23:26Z 41.4K followers, 15.5K engagements "Very excited about [--] new partners in the #DeltaSharing open ecosystem: - @Cloudflare R2 to let providers deliver data with no egress fees - @Twilio for accessing data from any compute system - @Oracle and @Dell for access to their DB and storage offerings https://sprou.tt/1m5NmM246t8 https://sprou.tt/1m5NmM246t8" [X Link](https://x.com/matei_zaharia/status/1671244607953199106) 2023-06-20T19:52Z 41.5K followers, 10.2K engagements "Data+AI Summit keynotes are starting soon Tune in online for free at https://www.databricks.com/dataaisummit/ https://www.databricks.com/dataaisummit/" [X Link](https://x.com/matei_zaharia/status/1674074341766729728) 2023-06-28T15:16Z 42K followers, 11.6K engagements "Meet #LakehouseIQ: a knowledge engine from your enterprise that understands your business & data to power AI apps. Every platform is adding an AI assistant but in data LLMs don't just work out of the box because every org has its own jargon data etc. https://www.databricks.com/blog/introducing-lakehouseiq-ai-powered-engine-uniquely-understands-your-business https://www.databricks.com/blog/introducing-lakehouseiq-ai-powered-engine-uniquely-understands-your-business" [X Link](https://x.com/matei_zaharia/status/1674095014744391680) 2023-06-28T16:38Z 42K followers, 46.5K engagements "We're incorporating LakehouseIQ into all Databricks UIs and making it available as an API to power your own internal Generative AI applications. We think this type of engine will be a new pillar in the enterprise software stack" [X Link](https://x.com/matei_zaharia/status/1674095018833858561) 2023-06-28T16:38Z 37.3K followers, [--] engagements "Huge launch today: with #LakehouseFederation you can use now Databricks to query and manage data in any system. Whether you want to build a #DataMesh or just give people access to data faster you get a single place for your users data ETL AI and BI" [X Link](https://x.com/matei_zaharia/status/1674134866470883330) 2023-06-28T19:17Z 36.2K followers, [--] engagements "One of my favorite announcements: English SDK for @ApacheSpark No more need to remember weird syntax just chain transformations in natural language with the familiar Spark API. So many fun examples. https://www.databricks.com/blog/introducing-english-new-programming-language-apache-spark https://www.databricks.com/blog/introducing-english-new-programming-language-apache-spark" [X Link](https://x.com/matei_zaharia/status/1674476458167902208) 2023-06-29T17:54Z 42K followers, 74.4K engagements "More details on UniForm which lets you read & write @DeltaLakeOSS tables as Apache Iceberg or Hudi. The whole point of open formats is interop so why were vendors creating these boundaries in support when 99.9% of the base data underneath is Parquet" [X Link](https://x.com/matei_zaharia/status/1674527230826020864) 2023-06-29T21:27Z 37.3K followers, [----] engagements "Here's our 1-minute demo of Delta Lake [---] universal format: reading a Delta table as Iceberg in #bigquery. This means @googlecloud BigQuery customers can now combine it with Databricks and other ecosystem software to reduce their ETL costs run AI etc" [X Link](https://x.com/matei_zaharia/status/1674837504095318017) 2023-06-30T17:49Z 37.3K followers, [--] engagements "Great post on being a product manager at Databricks. Were hiring in a number of areas" [X Link](https://x.com/matei_zaharia/status/1679879124008202242) 2023-07-14T15:42Z 36.2K followers, [----] engagements "We're very excited to be one of the launch partners for Meta's Llama [--] 🦙 We got to test Llama [--] in advance and were very impressed. The new version also has a much more permissive license. We've set everything up so you can run it on Databricks today" [X Link](https://x.com/matei_zaharia/status/1681378525830414338) 2023-07-18T19:00Z 36.2K followers, 49.7K engagements "Lots of people are wondering whether #GPT4 and #ChatGPT's performance has been changing over time so Lingjiao Chen @james_y_zou and I measured it. We found big changes including some large decreases in some problem-solving tasks:" [X Link](https://x.com/matei_zaharia/status/1681467961905926144) 2023-07-19T00:56Z 37.3K followers, 1.8M engagements "Welcome to @Databricks @MosaicML👋 MosaicML built an amazing product and team. Together we'll make it dramatically easier for enterprises to build control and customize AI for *their* use cases. A bit on why we're excited about the acquisition:" [X Link](https://x.com/matei_zaharia/status/1681766805134614529) 2023-07-19T20:43Z 36.2K followers, 11.4K engagements "@stevesi @simonw The "drift" was in GPT-4's response to the "think step-by-step" instruction which the post you quoted reproduced. That post found that GPT-4 was bad at arithmetic too which we didn't notice but chain-of-thought is effective on other tasks and gets ignored now. Their text:" [X Link](https://x.com/matei_zaharia/status/1682577328365506560) 2023-07-22T02:45Z 37.3K followers, [---] engagements "As we worked with customers using LLMs a common pattern we saw was that everyone wanted to add a layer in front of the LLM API to manage credentials rate limits etc and to easily swap between models. We've built this the open source @MLflow AI Gateway: https://www.databricks.com/blog/announcing-mlflow-ai-gateway https://www.databricks.com/blog/announcing-mlflow-ai-gateway" [X Link](https://x.com/matei_zaharia/status/1683881516403941377) 2023-07-25T16:46Z 41.5K followers, 32.8K engagements "Lakehouse Federation on @databricks is now in Public Preview You can connect a wide range of databases in our catalog to give users a central place to query combine and govern them" [X Link](https://x.com/matei_zaharia/status/1684984561917435904) 2023-07-28T17:49Z 36.2K followers, [----] engagements "Our new MOOC on #LLM Foundation Models from the Ground Up is now available Join me Chengyin Eng @sjraymond Joseph Bradley and @abhi_venigalla for a detailed look at how LLMs are built how to improve them and where the field is going. https://www.edx.org/learn/computer-science/databricks-large-language-models-foundation-models-from-the-ground-up https://www.edx.org/learn/computer-science/databricks-large-language-models-foundation-models-from-the-ground-up" [X Link](https://x.com/matei_zaharia/status/1691523188881256449) 2023-08-15T18:52Z 42K followers, 43.7K engagements "This is a big release: we've spent the past [--] years working on LLM pipelines and retrieval-augmented apps in my group and came up with this rich programming model based on our learnings. It not only defines but *automatically optimizes* pipelines for you to get great results" [X Link](https://x.com/matei_zaharia/status/1694780620201938973) 2023-08-24T18:36Z 37.3K followers, 17.2K engagements "Really excited about this work to combine #FeatureStore + #UnityCatalog on @Databricks. Why have a separate catalog for ML data A unified catalog enables powerful workflows across data and ML engineering. https://sprou.tt/1zW3pHQVDzD https://sprou.tt/1zW3pHQVDzD" [X Link](https://x.com/matei_zaharia/status/1696587206440173764) 2023-08-29T18:14Z 41.5K followers, [----] engagements "How can you efficiently evaluate RAG-based LLM applications like document question answering We've tested several methods on our internal question answering applications at Databricks and found some effective ways to do this using LLMs. https://sprou.tt/1ONB5nHrOlY https://sprou.tt/1ONB5nHrOlY" [X Link](https://x.com/matei_zaharia/status/1702019698655731916) 2023-09-13T18:01Z 41.5K followers, 53.9K engagements "Optimized LLM serving is now in public preview on @databricks Heres how to get low-latency highly available serving for your favorite LLMs including #Llama2 and #MPT across clouds:" [X Link](https://x.com/matei_zaharia/status/1707506527341572490) 2023-09-28T21:24Z 36.4K followers, [----] engagements "We've launched some great industry-specific solution accelerators on Databricks Marketplace with @CleanlabAI @Graphistry and @JohnSnowLabs. Check out these free resources with notebooks and sample data for healthcare cybersecurity & communications" [X Link](https://x.com/matei_zaharia/status/1716165085297520991) 2023-10-22T18:50Z 36.4K followers, [----] engagements "@ArcionLabs @databricks Congrats and welcome" [X Link](https://x.com/matei_zaharia/status/1716506220805456050) 2023-10-23T17:25Z 36.3K followers, [---] engagements "Really cool use case where MetaDialog built the best Arabic-language dataset for LLMs and a state-of-the-art model for advanced RAG in their domain. We're seeing many companies get fantastic results as they customize and extend LLMs for their application" [X Link](https://x.com/matei_zaharia/status/1717997004134244397) 2023-10-27T20:09Z 36.3K followers, 11.2K engagements "Thrilled to receive this award; the credit is due to my students my mentors my collaborators in academia and open source and my colleagues at Databricks for making all this work happen The [----] @ACMSIGOPS Mark Weiser was presented to @matei_zaharia for innovation and impact in large-scale data processing. The award was announced at @sospconf From next year awards will be announced annually as @sospconf is now an annual conference. See you in #austin in [----] The [----] @ACMSIGOPS Mark Weiser was presented to @matei_zaharia for innovation and impact in large-scale data processing. The award was" [X Link](https://x.com/matei_zaharia/status/1718694438997000443) 2023-10-29T18:21Z 41.5K followers, 78.6K engagements "MLflow [---] is out today with new support for LLM-based eval metrics among other features. Read about how we've been using it to improve our RAG apps at Databricks like our docs assistant: https://www.databricks.com/blog/announcing-mlflow-28-llm-judge-metrics-and-best-practices-llm-evaluation-rag-applications-partutm_source=twitter&utm_medium=organic-social https://www.databricks.com/blog/announcing-mlflow-28-llm-judge-metrics-and-best-practices-llm-evaluation-rag-applications-partutm_source=twitter&utm_medium=organic-social" [X Link](https://x.com/matei_zaharia/status/1719462318428524810) 2023-10-31T21:12Z 41.6K followers, 37K engagements "Not saying its the data but congrats Rangers on an amazing season The @Rangers are the champions HUGE congrats on an incredible #WorldSeries win The Rangers are constantly finding new ways to leverage data and AI in its strategy - a big role model for other teams. Were so proud to support these innovations https://t.co/vNZtuWemPz https://t.co/gaPphaVm9u The @Rangers are the champions HUGE congrats on an incredible #WorldSeries win The Rangers are constantly finding new ways to leverage data and AI in its strategy - a big role model for other teams. Were so proud to support these innovations" [X Link](https://x.com/matei_zaharia/status/1719950580695859483) 2023-11-02T05:32Z 41.6K followers, 19.1K engagements "How will generative AI change data platforms We argue that the impact will be fundamental not incremental through a new generation of platforms that deeply understand the content of the data (Data Intelligence Platforms)" [X Link](https://x.com/matei_zaharia/status/1724937900545200137) 2023-11-15T23:50Z 36.6K followers, 11.8K engagements "Very excited about this work started during Jon's research internship at @Databricks. We're hiring research interns for next year now in RAG RLHF model training efficient ML and more" [X Link](https://x.com/matei_zaharia/status/1725025574211723686) 2023-11-16T05:38Z 36.6K followers, 13.5K engagements "As good a time to say this as any: if youre on the AI research job market Databricks is hiring with the mission to democratize AI. We power amazing customer use cases and we publish. Check or reach out. https://www.databricks.com/company/careers https://www.databricks.com/company/careers" [X Link](https://x.com/matei_zaharia/status/1725759748421918728) 2023-11-18T06:16Z 41.4K followers, 43.5K engagements "Sad about the chaos around OpenAI which was crazier than anyone imagined and how its affecting people especially those on visas. I hope everyone lands on their feet" [X Link](https://x.com/matei_zaharia/status/1726828547917160652) 2023-11-21T05:03Z 36.6K followers, 23.1K engagements "We've just released a suite of awesome features for building high-quality RAG apps on Databricks: In talking with enterprises we found quality was often the top concern with RAG so we help teams monitor and improve it at all levels of the stack. https://www.databricks.com/blog/building-high-quality-rag-applications-databricks https://www.databricks.com/blog/building-high-quality-rag-applications-databricks" [X Link](https://x.com/matei_zaharia/status/1732529724558360747) 2023-12-06T22:37Z 42.9K followers, 23.3K engagements "The launches today: - Vector search for unstructured data - Online feature serving to make structured data available to RAG - Pay-by-token foundation model serving (LLaMa MPT and more) - Quality monitoring for production RAG apps - LLM and chain evaluation tools" [X Link](https://x.com/matei_zaharia/status/1732529726038929526) 2023-12-06T22:37Z 36.9K followers, [----] engagements "With these tools you can mix-and-match the best commercial or OSS models tune each component of the pipeline and monitor it all as data tables with all the functionality of the Databricks platform" [X Link](https://x.com/matei_zaharia/status/1732529727322325121) 2023-12-06T22:37Z 37.3K followers, [----] engagements "@AmbikaSukla Looks cool We'll have to try it on some datasets. It should be straightforward to run this and load the chunks into our vector store and pipelines" [X Link](https://x.com/matei_zaharia/status/1732532441108410433) 2023-12-06T22:48Z 36.9K followers, [--] engagements "There was a similar issue in a post from Microsoft earlier about "unlocking expertise" of GPT-4: the results stem from a good inference strategy with CoT and ensembling not just from GPT-4 which is only a statistical model" [X Link](https://x.com/matei_zaharia/status/1732621413520163123) 2023-12-07T04:41Z 36.9K followers, [----] engagements "As another example think 80% on GSM8k is impressive GPT-3.5 scored at 57% in OpenAI's own 5-shot eval but we got it to 80% with a small chaining + ensemble inference program in DSPy (Table [--] of We also got Llama-13B from 7% to 50%" [X Link](https://x.com/matei_zaharia/status/1732621415105634320) 2023-12-07T04:41Z 36.8K followers, [----] engagements "In short statistical model can't answer questions -- an inference system does. There's a lot of depth to figuring out the best inference systems/methods. CoT ToT few-shot etc explore this space and frameworks like our automatically optimize over it" [X Link](https://x.com/matei_zaharia/status/1732621417735401739) 2023-12-07T04:41Z 36.9K followers, 13.4K engagements "Within this context it is also super interesting to train models that are better at certain inference strategies like CoT. We're exploring this on the research team at Databricks/MosaicML" [X Link](https://x.com/matei_zaharia/status/1732621776864374790) 2023-12-07T04:43Z 36.9K followers, [----] engagements "Everyone is doing RAG on unstructured docs but what if you want to mix in structured business data Databricks RAG can connect to feature tables & functions to query the latest data in your catalog all with centralized governance security and MLOps. https://sprou.tt/1BoOJyvUN8J https://sprou.tt/1BoOJyvUN8J" [X Link](https://x.com/matei_zaharia/status/1733626864873222472) 2023-12-09T23:17Z 41.6K followers, 25.1K engagements "@AmbikaSukla I like your article -- catalogs and semantic layers definitely need to be expanded and cleaned up to fully integrate AI. For what it's worth we do have Lakehouse Federation in Databricks that lets you catalog and query data in other platforms:" [X Link](https://x.com/matei_zaharia/status/1733635139283116484) 2023-12-09T23:50Z 36.9K followers, [---] engagements "I'll be at #NeurIPS Tuesday-Friday this week ping me to connect We're recruiting researchers at @Databricks / @MosaicML with some really unique opportunities so drop by our social on Tuesday to chat with the team: https://events.databricks.com/Generative-AI-Social https://events.databricks.com/Generative-AI-Social" [X Link](https://x.com/matei_zaharia/status/1734288791828079105) 2023-12-11T19:07Z 41.5K followers, 15.3K engagements "Lakehouse Monitoring is now in public preview It's the industry's only unified quality service across data and AI with auto-generated metrics and dashboards and all info queryable as tables. It greatly simplifies life for both data and ML developers. https://sprou.tt/1HfTvaTHjzA https://sprou.tt/1HfTvaTHjzA" [X Link](https://x.com/matei_zaharia/status/1734973119406669944) 2023-12-13T16:26Z 41.4K followers, [----] engagements "Proud to see Databricks named a leader in the Gartner CDBMS MQ for the 3rd year advancing in both dimensions Weve made so many improvements to the platform this year and were just getting started with data intelligence marketplace cleanrooms & more. https://www.databricks.com/blog/databricks-named-leader-2023-gartner-magic-quadrant-cloud-database-management-systems https://www.databricks.com/blog/databricks-named-leader-2023-gartner-magic-quadrant-cloud-database-management-systems" [X Link](https://x.com/matei_zaharia/status/1738077736168722488) 2023-12-22T06:03Z 41.9K followers, 31K engagements "A lot happened in Databricks SQL in [----] -- no wonder it's one of the fastest growing data warehouse platforms. Read how we improved latency and concurrency made it serverless and began automatically optimizing most workloads with AI: https://www.databricks.com/blog/databricks-sql-year-review-part-i-ai-optimized-performance-and-serverless-compute https://www.databricks.com/blog/databricks-sql-year-review-part-i-ai-optimized-performance-and-serverless-compute" [X Link](https://x.com/matei_zaharia/status/1751368991657132434) 2024-01-27T22:18Z 41.6K followers, 23.2K engagements "@tim_kraska Congrats Tim and team" [X Link](https://x.com/matei_zaharia/status/1752363896231612521) 2024-01-30T16:11Z 37.4K followers, [----] engagements "Really proud that Databricks powered training @allen_ai'sOLMo 7B an open source state-of-the-art LLM that includes data code and checkpoints for all stages of training to promote open science. Awesome research contribution by AI2. https://sprou.tt/1f2199putg5 https://sprou.tt/1f2199putg5" [X Link](https://x.com/matei_zaharia/status/1753149976027308363) 2024-02-01T20:15Z 41.5K followers, [----] engagements "Interesting trend in AI: the best results are increasingly obtained by compound systems not monolithic models. AlphaCode ChatGPT+ Gemini are examples. In this post we discuss why this is and emerging research on designing & optimizing such systems. https://bair.berkeley.edu/blog/2024/02/18/compound-ai-systems/ https://bair.berkeley.edu/blog/2024/02/18/compound-ai-systems/" [X Link](https://x.com/matei_zaharia/status/1759614283066089684) 2024-02-19T16:21Z 39.1K followers, 283.7K engagements "Compound AI systems solve tasks through multiple calls to models and other components. Many recent state-of-the-art results and LLM programming techniques (chaining RAG) use compound systems" [X Link](https://x.com/matei_zaharia/status/1759614284244611311) 2024-02-19T16:21Z 38.1K followers, [----] engagements "Even LLM developers are now reporting results from inference strategies that call the model multiple times as Google did for Gemini on MMLU with CoT@32: This thread highlights a point we've been seeing in https://t.co/2ZsWoHElXJ for a while: you can't meaningfully talk about capabilities of a *language model* you have to talk about capabilities of a *system* including the inference algorithm. 32-CoT is not the same as 5-shot. This thread highlights a point we've been seeing in https://t.co/2ZsWoHElXJ for a while: you can't meaningfully talk about capabilities of a *language model* you have to" [X Link](https://x.com/matei_zaharia/status/1759614285888758176) 2024-02-19T16:21Z 38.5K followers, [----] engagements "And at @databricks we found that over 60% of enterprise customers' LLM applications used retrieval and 30% used complex multi-step chains" [X Link](https://x.com/matei_zaharia/status/1759614287625289859) 2024-02-19T16:21Z 38.5K followers, [----] engagements "Why are developers using compound systems and are they here to stay as models improve We think yes because they have [--] key advantages over models alone: [--]. More return-vs-cost in many cases [--]. Dynamicity [--]. Much better control safety & trust [--]. More cost-quality options" [X Link](https://x.com/matei_zaharia/status/1759614288732512414) 2024-02-19T16:21Z 38.1K followers, [----] engagements "But as people shift to compound AI systems an emerging question is how to design optimize & operate them. We can't use the same tools as for models e.g. they're not differentiable. We discuss some research on this like #DSPy and #FrugalGPT which can auto-optimize AI systems" [X Link](https://x.com/matei_zaharia/status/1759614289969848492) 2024-02-19T16:21Z 38K followers, [----] engagements "Really cool example of a compound AI *system* that enables new AI capabilities and its built using DSPy. I expect well see a lot more like it this year. I asked 🌪STORM to write an article on ColBERT. It produced a 3500-word article with [--] references 📸 Screenshots: * Part of the Table of Contents * Intro * Funny but important section on how "ColBERT late interaction" is different from "Colbert's Late Show" https://t.co/YXdgHABAm9 I asked 🌪STORM to write an article on ColBERT. It produced a 3500-word article with [--] references 📸 Screenshots: * Part of the Table of Contents * Intro * Funny" [X Link](https://x.com/matei_zaharia/status/1763086195549217159) 2024-02-29T06:18Z 38.2K followers, 25.7K engagements "Delta Sharing on @Cloudflare R2 is now in public preview on @Databricks allowing customers to distribute data globally with no egress fees Enables data delivery to any region and any compute platform thanks to the open Delta Sharing protocol. https://www.databricks.com/blog/announcing-public-preview-delta-sharing-cloudflare-r2-integration https://www.databricks.com/blog/announcing-public-preview-delta-sharing-cloudflare-r2-integration" [X Link](https://x.com/matei_zaharia/status/1763283246077677673) 2024-02-29T19:21Z 40.6K followers, 16.4K engagements "@lmeyerov I wanted a broader term that can capture things like self-driving cars as well which use multiple components but no LLMs. Then you can look at questions across these such as how to best optimize a multi-component system. Definitely makes sense to consider a general agent too" [X Link](https://x.com/matei_zaharia/status/1763326808513245454) 2024-02-29T22:14Z 38.2K followers, [---] engagements "We're running a great webinar on getting value from GenAI with @NaveenGRao @jefrankle and industry experts on March 14th. We'll also cover a bit of recent research from @Databricks Check it out: https://www.databricks.com/resources/webinar/gen-ai-payoff-2024utm_source=twitter&utm_medium=organic-social&utm_scid=701Vp000000ij02IAA https://www.databricks.com/resources/webinar/gen-ai-payoff-2024utm_source=twitter&utm_medium=organic-social&utm_scid=701Vp000000ij02IAA" [X Link](https://x.com/matei_zaharia/status/1767655518284468323) 2024-03-12T20:54Z 39.4K followers, [----] engagements "Databricks Feature Serving is now GA letting you read online data from your tables directly into ML and GenAI apps. Connect AI to *your* data https://www.databricks.com/blog/announcing-general-availability-databricks-feature-serving https://www.databricks.com/blog/announcing-general-availability-databricks-feature-serving" [X Link](https://x.com/matei_zaharia/status/1768344794663944595) 2024-03-14T18:33Z 39.4K followers, [----] engagements "Super excited to announce that @lilac_ai is joining Databricks Lilac has built amazing tech for exploring and cleaning text data at scale that well help bring to every AI user. https://www.databricks.com/blog/lilac-joins-databricks-simplify-unstructured-data-evaluation-generative-ai https://www.databricks.com/blog/lilac-joins-databricks-simplify-unstructured-data-evaluation-generative-ai" [X Link](https://x.com/matei_zaharia/status/1770124274722062347) 2024-03-19T16:24Z 39.4K followers, [----] engagements "Even the largest language models hallucinate. Thats why a lot of the action will likely be in compound AI systems to get highly accurate AI. Claude [--] Opus believes I am the co-founder and CEO of Anthropic where I "maintain a relatively low public profile": https://t.co/MxVBmcyuMr Claude [--] Opus believes I am the co-founder and CEO of Anthropic where I "maintain a relatively low public profile": https://t.co/MxVBmcyuMr" [X Link](https://x.com/matei_zaharia/status/1771039176231956808) 2024-03-22T05:00Z 38.8K followers, 18.4K engagements "Congrats to my student @ChenLingjiao for having two papers cited in the White House [----] Economic Report: HAPI and LLM shift in chapter [--] on economics of AI. Lingjiao was prescient to start studying ML-as-a-service and did other cool work like FrugalGPT. https://www.whitehouse.gov/cea/written-materials/2024/03/21/the-2024-economic-report-of-the-president/ https://www.whitehouse.gov/cea/written-materials/2024/03/21/the-2024-economic-report-of-the-president/" [X Link](https://x.com/matei_zaharia/status/1771391168103989338) 2024-03-23T04:18Z 38.9K followers, 27.7K engagements "DBRX is a 132B parameter MoE model with 36B active params and fine-grained (4-of-16) sparsity and 32K context. It was trained using the dropless MoE approach pioneered by my student @Tgale96 in MegaBlocks. Technical details: https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm" [X Link](https://x.com/matei_zaharia/status/1772972274053701799) 2024-03-27T13:01Z 39.4K followers, [----] engagements "You can try DBRX on Databricks model serving and playground today with an OpenAI-compatible API And if you want to tune RLHF or train your own model we have everything we needed to build this from scratch" [X Link](https://x.com/matei_zaharia/status/1772972275899228255) 2024-03-27T13:01Z 39.4K followers, [----] engagements "@natolambert @databricks Just our serving stack It will probably get even faster soon. Having just 36B live params makes a big difference" [X Link](https://x.com/matei_zaharia/status/1773001998843199499) 2024-03-27T14:59Z 38.9K followers, [----] engagements "Probably the thing Im most excited about with DBRX its super fast Easily [---] tokens/s for quality comparable to much slower closed models. Okay @databricks what're you cooking behind this space its so fast lmao https://t.co/DCWHOb6bUY Okay @databricks what're you cooking behind this space its so fast lmao https://t.co/DCWHOb6bUY" [X Link](https://x.com/matei_zaharia/status/1773002564188954768) 2024-03-27T15:02Z 39K followers, 19.7K engagements "@corbtt @databricks @jefrankle 👀" [X Link](https://x.com/matei_zaharia/status/1773157667701215546) 2024-03-28T01:18Z 39K followers, [---] engagements "Were hiring for the RAG / AG research team at Databricks. Come help make AI even better at incorporating real-time data and external tools. Hows your sabbatical WellDBRX is GREAT at RAG If youve been using Mixtral/Llama2/GPT3.5 then try DBRX The combination of RAG with its SoTA capabilities on knowledge/code/reasoning will unlock new CompoundAI opportunities. https://t.co/axbFHEHihl https://t.co/xnb4yujtaI Hows your sabbatical WellDBRX is GREAT at RAG If youve been using Mixtral/Llama2/GPT3.5 then try DBRX The combination of RAG with its SoTA capabilities on knowledge/code/reasoning will" [X Link](https://x.com/matei_zaharia/status/1773162462843425122) 2024-03-28T01:37Z 39.4K followers, 40.6K engagements "@MaziyarPanahi Its Databricks Model Serving" [X Link](https://x.com/matei_zaharia/status/1773236499556786343) 2024-03-28T06:31Z 39K followers, [--] engagements "@MaziyarPanahi @alighodsi @databricks Were working on simplifying the signup process for this. But right now once you create a Databricks account you can just directly call the open source models we host and pay by token even using an OpenAI client: https://docs.databricks.com/en/machine-learning/model-serving/score-foundation-models.html https://docs.databricks.com/en/machine-learning/model-serving/score-foundation-models.html" [X Link](https://x.com/matei_zaharia/status/1774595216365977821) 2024-04-01T00:30Z 39.1K followers, [--] engagements "Excited to speak about data intelligence and developments in open source data & AI in Tokyo tomorrow. Will cover #DBRX and the latest in @ApacheSpark (which we used to create the data for DBRX)" [X Link](https://x.com/matei_zaharia/status/1775007402431263094) 2024-04-02T03:48Z 39.1K followers, [--] engagements "Translated by #DBRX: 🔥Gen AI Meetup with Databricks CTO🔥 It's finally happening today🌸 Use the hashtag #matei_meetup to share your tweets☺ 🌟 Registration link Time April 3rd (Wednesday) 18:00- 📍 Location Otemachi Mitsui Hall" [X Link](https://x.com/matei_zaharia/status/1775439231558865278) 2024-04-03T08:24Z 39K followers, [--] engagements "AI can address the data warehouses biggest challenges thanks to its deeper understanding of your data and how its used. Join us in May to hear from @rxin how AI at Databricks helps users find and query the right data faster and auto-optimize performance. https://sprou.tt/146AfuXt02s https://sprou.tt/146AfuXt02s" [X Link](https://x.com/matei_zaharia/status/1777144742070964255) 2024-04-08T01:21Z 40.2K followers, [----] engagements "This is a cool paper but @ChenLingjiao and team's recent research showed that with majority voting performance can actually *decrease* past a certain number of agent calls. Check out There's lots left to figure out how to best build compound AI systems. "More Agents Is All You Need" - Nice Paper "When the ensemble size scales up to [--] Llama2-13B achieves comparable accuracy with Llama2-70B. Similarly When the ensemble size scales up to [--] and [--] Llama2-70B and GPT-3.5-Turbo achieve comparable accuracy with their more https://t.co/WeHda4SAHn" [X Link](https://x.com/matei_zaharia/status/1777146420363227632) 2024-04-08T01:28Z 39.1K followers, 22.4K engagements "We've added a lot of improvements for the deep learning training experience in @MLflow recently. Check out the latest from @_aiabe the product lead for this area at Databricks. https://www.loom.com/share/443a398dabd44eb2a30584036340f35e https://www.loom.com/share/443a398dabd44eb2a30584036340f35e" [X Link](https://x.com/matei_zaharia/status/1777760940257399251) 2024-04-09T18:10Z 40.2K followers, [----] engagements "Love how fast DBRX is that was one of our goals There are many strong open source models coming out which is awesome -- excited to see what people do with these. Latest AI showdown 🤜🏼🤛🏼 [--]. @MistralAI 8x22B vs @databricks DBRX Instruct [--]. @GoogleAI Gemini [---] Pro vs new @OpenAI GPT-4-Turbo vision. Details 👇 https://t.co/gsq7nXPhMG Latest AI showdown 🤜🏼🤛🏼 [--]. @MistralAI 8x22B vs @databricks DBRX Instruct [--]. @GoogleAI Gemini [---] Pro vs new @OpenAI GPT-4-Turbo vision. Details 👇 https://t.co/gsq7nXPhMG" [X Link](https://x.com/matei_zaharia/status/1778840871859016189) 2024-04-12T17:41Z 39.2K followers, 11.3K engagements "Another major data provider on Databricks Marketplace welcome @ICE_Markets Premier datasets in finance are now available on the #DatabricksMarketplace thanks to @ICE_Markets. These datasets enable key use cases like time-series analysis relative value spread analysis and assessing climate risk exposure. https://t.co/rmei6qZ93G https://t.co/smLStSlB8f Premier datasets in finance are now available on the #DatabricksMarketplace thanks to @ICE_Markets. These datasets enable key use cases like time-series analysis relative value spread analysis and assessing climate risk exposure." [X Link](https://x.com/matei_zaharia/status/1780756697646235958) 2024-04-18T00:34Z 40.5K followers, [----] engagements "Awesome release congrats @AIatMeta and excited that Databricks is a launch partner Introducing Meta Llama 3: the most capable openly available LLM to date. Today were releasing 8B & 70B models that deliver on new capabilities such as improved reasoning and set a new state-of-the-art for models of their sizes. Today's release includes the first two Llama [--] https://t.co/Q80lVTeS7m Introducing Meta Llama 3: the most capable openly available LLM to date. Today were releasing 8B & 70B models that deliver on new capabilities such as improved reasoning and set a new state-of-the-art for models of" [X Link](https://x.com/matei_zaharia/status/1780998486995169678) 2024-04-18T16:35Z 40.5K followers, 13.5K engagements "I'm co-organizing the inaugural research workshop on Compound AI Systems on June 13th: . Send in your work on designing & optimizing such systems Thrilled to have @RichardSocher @MonicaSLam and @polynoamial as speakers and host this at @Data_AI_Summit. https://sites.google.com/view/compound-ai-systems-workshop/home https://sites.google.com/view/compound-ai-systems-workshop/home" [X Link](https://x.com/matei_zaharia/status/1782541715737645256) 2024-04-22T22:47Z 39.5K followers, 38K engagements "Databricks Asset Bundles (DABs) is now GA. It lets you deploy data and AI projects as config-based packages and integrates great with Git CI/CD and IDEs -- greatly streamlines data and AI deployment using modern software engineering practices. https://sprou.tt/1ubhaEia3Eu https://sprou.tt/1ubhaEia3Eu" [X Link](https://x.com/matei_zaharia/status/1782908283793162655) 2024-04-23T23:03Z 40.5K followers, [----] engagements "Super cool that this state-of-the-art medical NLP result was achieved using @lateinteraction's #DSPy. Beginning of the age of auto-optimized compound AI systems IReRa is another example of an auto-optimized SOTA pipeline https://arxiv.org/abs/2401.12178 (1/3) 🎉 Exciting News: Our WangLab team has won first place in the [----] MEDIQA Clinical NLP competitions for the second consecutive year 🥇🥇 This year MEDIQA [----] has two tracks: 1) Medical Error Detection & Correction; 2) Multilingual & Multimodal Medical Answer https://t.co/1HhuMNKc9I https://arxiv.org/abs/2401.12178 (1/3) 🎉 Exciting" [X Link](https://x.com/matei_zaharia/status/1784029979287978299) 2024-04-27T01:21Z 39.5K followers, 29.4K engagements "When you share a dataset with Delta Sharing @tableau users can now directly connect to it That's the benefit of an open protocol for data sharing which Delta Sharing uniquely provides. Don't build your collaboration architecture on something closed. Excited to introduce the new @tableau #DeltaSharing connector and 'Explore in Tableau' capability Together these updates will help customers simplify data sharing + collaboration and uncover insights faster. #Data24 https://t.co/ZF26b9nAky Excited to introduce the new @tableau #DeltaSharing connector and 'Explore in Tableau' capability Together" [X Link](https://x.com/matei_zaharia/status/1786430860931289378) 2024-05-03T16:21Z 40.4K followers, [----] engagements "Want to talk AI research and best practices with the people working on it The @DbrxMosaicAI research team is running meetups worldwide in May. https://www.linkedin.com/pulse/databricks-mosaic-ai-meetups-coming-city-near-you-mosaicresearch-q93qc/trackingId=kwTVyPfOQVSockQo7lR5kw%3D%3D https://www.linkedin.com/pulse/databricks-mosaic-ai-meetups-coming-city-near-you-mosaicresearch-q93qc/trackingId=kwTVyPfOQVSockQo7lR5kw%3D%3D" [X Link](https://x.com/matei_zaharia/status/1786434101068841099) 2024-05-03T16:34Z 40.5K followers, 25.2K engagements "Super excited that @drfeifei will be speaking at Data + AI Summit Check it out on June 10-13. Explore the next frontier of AI with @drfeifei Professor @Stanford Co-Director @StanfordHAI & leader of human-centered AI she'll be sharing tons of insights at #DataAISummit. Don't miss it register now https://t.co/aBfW0Qf0lk https://t.co/FAa6Pztrmu Explore the next frontier of AI with @drfeifei Professor @Stanford Co-Director @StanfordHAI & leader of human-centered AI she'll be sharing tons of insights at #DataAISummit. Don't miss it register now https://t.co/aBfW0Qf0lk https://t.co/FAa6Pztrmu" [X Link](https://x.com/matei_zaharia/status/1788251253203673388) 2024-05-08T16:54Z 40.5K followers, 15.2K engagements "Very excited to hear @YejinChoinka speak at this year's #DataAISummit. Join us on June 10-13. Don't miss the #DataAISummit keynote from Yejin Choi Professor + Sr. Research Director for Commonsense AI at AI2 We recently worked with AI2 to train their OLMo 7B a SOTA LLM on Databricks #MosaicAI. Don't miss great GenAI insights Register now https://t.co/aBfW0Qf0lk https://t.co/bRTrktmI0R Don't miss the #DataAISummit keynote from Yejin Choi Professor + Sr. Research Director for Commonsense AI at AI2 We recently worked with AI2 to train their OLMo 7B a SOTA LLM on Databricks #MosaicAI. Don't miss" [X Link](https://x.com/matei_zaharia/status/1788641972250616269) 2024-05-09T18:47Z 43.5K followers, [----] engagements "Really thrilled to announce @lmthang as a speaker at the Compound AI Systems workshop Thang is a Researcher at DeepMind and will discuss his teams recent work on #AlphaGeometry. Submit your talks to the workshop by May https://sites.google.com/view/compound-ai-systems-workshop/home https://sites.google.com/view/compound-ai-systems-workshop/home" [X Link](https://x.com/matei_zaharia/status/1789051426951622978) 2024-05-10T21:54Z 40.5K followers, [----] engagements "Other speakers include: @polynoamialResearch Scientist at OpenAI and pioneer in multi-step reasoning self-play and multi-agent AI. @MonicaSLamProfessor of CS at Stanford and director of OVAL lab. @RichardSocherFounder and CEO and NLP pioneer. http://You.com http://You.com" [X Link](https://x.com/matei_zaharia/status/1789051427937284422) 2024-05-10T21:54Z 40.5K followers, [----] engagements "We just launched Databricks Assistant Autocomplete another context-aware AI feature using our data intelligence engine. Now your autocomplete in notebooks and SQL is aware of all the data in your catalog and how it is used https://sprou.tt/1bL8Hneo5iZ https://sprou.tt/1bL8Hneo5iZ" [X Link](https://x.com/matei_zaharia/status/1792978349280628983) 2024-05-21T17:58Z 40.8K followers, 16.1K engagements "@robsonluizsoul Yup we are adding collations support in Spark SQL and all parts of Databricks. Thanks for the feedback https://issues.apache.org/jira/browse/SPARK-46837 https://issues.apache.org/jira/browse/SPARK-46837" [X Link](https://x.com/matei_zaharia/status/1793029310669869203) 2024-05-21T21:21Z 40.7K followers, [---] engagements "Vector Search on Databricks is now GA You can just turn on vector search serving on an existing table to serve it without setting up other infra and we've optimized it for high retrieval quality and low latency. https://www.databricks.com/blog/announcing-mosaic-ai-vector-search-general-availability-databricks https://www.databricks.com/blog/announcing-mosaic-ai-vector-search-general-availability-databricks" [X Link](https://x.com/matei_zaharia/status/1793430250749325394) 2024-05-22T23:54Z 40.8K followers, [----] engagements "@PrescientTrade This probably wont help with traditional data warehousing use cases other than enabling similarly search but you can also use Databricks to build the data pipeline for an AI app and serve that data (for example crawled documents)" [X Link](https://x.com/matei_zaharia/status/1793479485700067502) 2024-05-23T03:10Z 40.7K followers, [---] engagements "Liquid Clustering is now GA on Databricks -- a new layout strategy that outperforms partitioning and does not require tuning. This went from an idea in our engineering team to supporting 1000+ customers and 100+ petabytes of tables in just one year https://www.databricks.com/blog/announcing-general-availability-liquid-clustering https://www.databricks.com/blog/announcing-general-availability-liquid-clustering" [X Link](https://x.com/matei_zaharia/status/1793772713993253209) 2024-05-23T22:35Z 40.9K followers, [----] engagements "Public registration for the Compound AI Systems workshop next week filled up in about [--] minutes but we've saved some spots for researchers. Sign up at to join the waitlist. See you at @Data_AI_Summit. https://docs.google.com/forms/d/1vjXr6paiju-To-NJQ360MRnnhyCY7k48Cwg2gOqaldI/edit https://docs.google.com/forms/d/1vjXr6paiju-To-NJQ360MRnnhyCY7k48Cwg2gOqaldI/edit" [X Link](https://x.com/matei_zaharia/status/1797738009120641308) 2024-06-03T21:11Z 41.1K followers, 13.2K engagements "The next generation of Databricks Notebooks is rolling out now with some awesome UX and performance improvements and context-aware AI. Here's what's new: https://www.databricks.com/blog/next-generation-databricks-notebooks-simple-and-powerful https://www.databricks.com/blog/next-generation-databricks-notebooks-simple-and-powerful" [X Link](https://x.com/matei_zaharia/status/1798395067847356434) 2024-06-05T16:42Z 41.1K followers, [----] engagements "Thrilled that Forrester named Databricks a Leader in their report on AI Foundation Models in enterprise We help organizations build the best AI for *their* domain and data using the best techniques available with a world-class research team to back it. https://www.databricks.com/blog/databricks-named-leader-forrester-wavetm-ai-foundation-models-language-q2-2024 https://www.databricks.com/blog/databricks-named-leader-forrester-wavetm-ai-foundation-models-language-q2-2024" [X Link](https://x.com/matei_zaharia/status/1798397775543197798) 2024-06-05T16:53Z 41.3K followers, 29.8K engagements "Check out @Data_AI_Summit next week for some exciting announcements on new infrastructure and research results that are helping customers achieve this" [X Link](https://x.com/matei_zaharia/status/1798397777778819221) 2024-06-05T16:53Z 40.9K followers, [----] engagements "We're excited to welcome [--] new strategic data collaboration partners into the Delta Sharing and Databricks Marketplace ecosystem bringing the best data and AI assets in the industry to users. Also cool that sharing on Databricks is growing 300% YoY https://www.databricks.com/company/newsroom/press-releases/databricks-doubles-down-delta-sharing-open-ecosystem-strategic-partnerships https://www.databricks.com/company/newsroom/press-releases/databricks-doubles-down-delta-sharing-open-ecosystem-strategic-partnerships" [X Link](https://x.com/matei_zaharia/status/1798825695340318875) 2024-06-06T21:14Z 41.3K followers, [----] engagements "@code_star This one does not spark AGI" [X Link](https://x.com/matei_zaharia/status/1799256084525539397) 2024-06-08T01:44Z 40.9K followers, [----] engagements "This Monday in SF our MosaicX meetup is essentially a mini-conference on AI Hear from @jefrankle @realSharonZhou @jerryjliu0 @sarahcat21 @JuliaANeagu @yaronsinger @jazco and many others on the latest research. We're kicking off the Data+AI Summit with the #MosaicX #Meetup: San Francisco Edition on Monday June 10th. We're at the #Moscone Center South 2nd floor with over [----] registrants and [--] speakers across four tracks. It's a "slightly" packed agenda with: ✅ Discussion panels https://t.co/REtSfMkR4h We're kicking off the Data+AI Summit with the #MosaicX #Meetup: San Francisco Edition on" [X Link](https://x.com/matei_zaharia/status/1799528373167034849) 2024-06-08T19:46Z 41.1K followers, 31.5K engagements "@NaveenGRao @Data_AI_Summit @databricks There arent many good excuses to miss @Data_AI_Summit but I guess this one is OK" [X Link](https://x.com/matei_zaharia/status/1800200820191080615) 2024-06-10T16:18Z 41.1K followers, [----] engagements "Super excited about the new Agent Framework Tool Catalog Vector Search Evaluation and Training capabilities we launched today in Mosaic AI. We see more companies building compound AI systems and we have created an end-to-end environment to do this. https://www.databricks.com/blog/mosaic-ai-build-and-deploy-production-quality-compound-ai-systems https://www.databricks.com/blog/mosaic-ai-build-and-deploy-production-quality-compound-ai-systems" [X Link](https://x.com/matei_zaharia/status/1800938692447699266) 2024-06-12T17:10Z 41.3K followers, 29.2K engagements "This is a great example of companies turning their data into new AI products: @Shutterstock partnered with @Databricks to create this state of the art text-to-image model. Awesome partnership with the @DbrxMosaicAI research team to make this fast and high-quality. today we're announcing our @DbrxMosaicAI x @Shutterstock partnership and a new text-to-image diffusion model: ✨ImageAI✨ this model is geared towards enterprise use cases and is trained exclusively on shutterstock's trusted data catalog https://t.co/H7FtlZs0ne https://t.co/DNKxz7zoTn today we're announcing our @DbrxMosaicAI x" [X Link](https://x.com/matei_zaharia/status/1800944154417176798) 2024-06-12T17:32Z 41.1K followers, [----] engagements "We just posted the first release of open source Unity Catalog It supports tables unstructured data and AI and we have a great set of partners across data and AI integrating with it. Read more at https://www.databricks.com/blog/open-sourcing-unity-catalog .@matei_zaharia just open sourced Unity Catalog LIVE at #DataAISummit https://t.co/jrLbvN0r1R https://www.databricks.com/blog/open-sourcing-unity-catalog .@matei_zaharia just open sourced Unity Catalog LIVE at #DataAISummit https://t.co/jrLbvN0r1R" [X Link](https://x.com/matei_zaharia/status/1801316850820911269) 2024-06-13T18:12Z 42.5K followers, 28.8K engagements "The Compound AI Workshop at DAIS is kicking off with @lmthang. Super excited about our program Thanks to the great speakers and organizers https://sites.google.com/view/compound-ai-systems-workshop/home https://sites.google.com/view/compound-ai-systems-workshop/home" [X Link](https://x.com/matei_zaharia/status/1801350501226922281) 2024-06-13T20:26Z 41.2K followers, 18.1K engagements "@Ken_Goldberg @databricks Fantastic talk Ken Thanks for joining" [X Link](https://x.com/matei_zaharia/status/1801463310317195672) 2024-06-14T03:54Z 41.1K followers, [---] engagements "@WangUWS @databricks @Data_AI_Summit Closest you can get to DJing at a tech conference I guess" [X Link](https://x.com/matei_zaharia/status/1801463989249122546) 2024-06-14T03:57Z 41.2K followers, [---] engagements "Compound AI systems for the win Makes sense that a program search approach could do well on this. I asked Buck about his thoughts on ARC-AGI to prepare for interviewing @fchollet. He tells his coworker Ryan and within [--] days they've beat SOTA on ARC and are on the heels of average human performance. 🤯 "On a held-out subset of the train set where humans get 85% accuracy https://t.co/MmlLe2Miuh I asked Buck about his thoughts on ARC-AGI to prepare for interviewing @fchollet. He tells his coworker Ryan and within [--] days they've beat SOTA on ARC and are on the heels of average human performance." [X Link](https://x.com/matei_zaharia/status/1802779683437895902) 2024-06-17T19:05Z 41.1K followers, 12K engagements "Really proud of our team for being named a leader in the Gartner MQ on Data Science and Machine Learning again and ranked highest in Ability to Execute By integrating ML deeply with data platform tools we're simplifying it in ways that other AI/ML platforms can't. Databricks named a Leader in the [----] Gartner Magic Quadrant for Data Science and ML Platforms & positioned highest in Ability to Execute out of all evaluated vendors We believe this recognition validates our focus on GenAI & traditional data science https://t.co/G7XqypmYnB https://t.co/f4UFC59Gdv Databricks named a Leader in the" [X Link](https://x.com/matei_zaharia/status/1803839066598957209) 2024-06-20T17:15Z 41.2K followers, [----] engagements "There are a lot of great new partners and features for Delta Sharing this year and its been growing 300% YoY to become one of the largest secure data sharing protocols in the industry (and the main cross platform one). Heres whats new: We recently announced new Delta Sharing innovations that enable Data + AI success This includes: - GA of volume sharing and Cloudflare R2 support - Cross-platform view sharing - Sharing for Lakehouse Federation and more👇 https://t.co/Wt1fHC52OS https://t.co/UiY7rbHUv6 We recently announced new Delta Sharing innovations that enable Data + AI success This" [X Link](https://x.com/matei_zaharia/status/1805705591735959753) 2024-06-25T20:52Z 41.3K followers, [----] engagements "Databricks Assistant our in-context AI is now GA I'm really proud of what the team built: it's one of the most effective AI assistants in the industry according to users thanks to integrating context like related code data usage patterns etc. https://sprou.tt/1j98qM3klMN https://sprou.tt/1j98qM3klMN" [X Link](https://x.com/matei_zaharia/status/1806475932619657442) 2024-06-27T23:53Z 41.3K followers, 21K engagements "Great to see @databricks' approach to data engineering and streaming recognized in two reports: - [----] IDC MarketScape: Worldwide Analytic Stream Processing - The Forrester Wave: Cloud Data Pipelines Q4'23 We're making these even better with Lakeflow. https://sprou.tt/1gUCxSfvh8m https://sprou.tt/1gUCxSfvh8m" [X Link](https://x.com/matei_zaharia/status/1810826291693727811) 2024-07-10T00:00Z 41.5K followers, [----] engagements "Great post by @celebaltech on implementing RAFT on top of @databricks fine-tuning to out-perform RAG: Incidentally the RAFT paper will be presented at @COLM_conf so check it out if you're there. https://celebaltech.com/blogs/enhancing-rag-systems-with-fine-tuned-language-models-on-databricks https://celebaltech.com/blogs/enhancing-rag-systems-with-fine-tuned-language-models-on-databricks" [X Link](https://x.com/matei_zaharia/status/1811455837426319697) 2024-07-11T17:41Z 41.5K followers, 13.8K engagements "@berenguel @celebaltech @databricks @COLM_conf Oh no that's confusing" [X Link](https://x.com/matei_zaharia/status/1811462671163969689) 2024-07-11T18:08Z 41.5K followers, [---] engagements "Congrats @AIatMeta on the Llama [---] release and super thrilled to be a launch partner Llama [---] is a huge step forward for open models at all scales. Thrilled to offer the @AIatMeta Llama [---] series of models on Databricks These models expand context length to 128K add multilingual capabilities + include Llama [---] 405B the largest + highest-quality openly available foundation model. https://t.co/C0Fcopr7dx Thrilled to offer the @AIatMeta Llama [---] series of models on Databricks These models expand context length to 128K add multilingual capabilities + include Llama [---] 405B the largest +" [X Link](https://x.com/matei_zaharia/status/1815775023271223575) 2024-07-23T15:44Z 41.6K followers, [----] engagements "@gkhandya @AIatMeta Yup" [X Link](https://x.com/matei_zaharia/status/1815778141635498187) 2024-07-23T15:56Z 41.6K followers, [--] engagements "How can you make LLM-as-judge reliable in specialized domains Our applied AI team developed a simple but effective approach called Grading Notes that we've been using in Databricks Assistant. We think this can help anyone doing domain-specific AI https://www.databricks.com/blog/enhancing-llm-as-a-judge-with-grading-notes https://www.databricks.com/blog/enhancing-llm-as-a-judge-with-grading-notes" [X Link](https://x.com/matei_zaharia/status/1816175703290962080) 2024-07-24T18:16Z 41.6K followers, 16.8K engagements "We're hosting the Berkeley LLM Meetup next week at Databricks with talks by #DSPy's @michaelryan207 on prompt optimization and SWE-Agent's creator @_carlosejimenez on automating software engineering with LLMs. Sign up here: https://lu.ma/berkeley-llm-meetup-july https://lu.ma/berkeley-llm-meetup-july" [X Link](https://x.com/matei_zaharia/status/1816940566967619765) 2024-07-26T20:56Z 41.7K followers, 13.5K engagements "Data sharing features are often locked into one platform. We started #DeltaSharing as the first open protocol for data sharing and its taking off: 40% of our customers shares go outside Databricks Read how @Atlassian @Nasdaq @Oracle and others use it: https://www.databricks.com/blog/democratizing-data-sharing-platform-agnostic-approach https://www.databricks.com/blog/democratizing-data-sharing-platform-agnostic-approach" [X Link](https://x.com/matei_zaharia/status/1819028648831414272) 2024-08-01T15:13Z 41.7K followers, [----] engagements "Databricks Clean Rooms are now in public preview letting you do private joint computation with any API in Databricks (SQL Python R Apache Spark ML GenAI and more) combining data from multiple organizations on different clouds and platforms. https://www.databricks.com/blog/databricks-clean-rooms-privacy-safe-collaboration-public-preview https://www.databricks.com/blog/databricks-clean-rooms-privacy-safe-collaboration-public-preview" [X Link](https://x.com/matei_zaharia/status/1821304865664200712) 2024-08-07T21:58Z 42.8K followers, [----] engagements "Does long context solve RAG We found that many long-context models fail in specific and weird ways as you grow context length making the optimal system design non-obvious. Some models tend to say there's a copyright issue some tend to summarize etc. https://www.databricks.com/blog/long-context-rag-performance-llms https://www.databricks.com/blog/long-context-rag-performance-llms" [X Link](https://x.com/matei_zaharia/status/1823383042523791654) 2024-08-13T15:36Z 42.2K followers, 40.2K engagements "Not a problem with Lakehouse. my friend works in fashion. i set her up with one of my tech homies. this is how it went. https://t.co/7kU3DN86ai my friend works in fashion. i set her up with one of my tech homies. this is how it went. https://t.co/7kU3DN86ai" [X Link](https://x.com/matei_zaharia/status/1823525648901792258) 2024-08-14T01:02Z 42.2K followers, 53.9K engagements "Welcome Omar and really excited to keep working together on research along with the DSPy community. Some personal news: I'm thrilled to have joined @Databricks @DbrxMosaicAI as a Research Scientist last month before I start as MIT faculty in July [----] Expect increased investment into the open-source DSPy community new research & strong emphasis on production concerns 🧵. Some personal news: I'm thrilled to have joined @Databricks @DbrxMosaicAI as a Research Scientist last month before I start as MIT faculty in July [----] Expect increased investment into the open-source DSPy community new" [X Link](https://x.com/matei_zaharia/status/1825669623544697227) 2024-08-19T23:02Z 42.3K followers, 18.7K engagements "@nandan__thakur @databricks @DbrxMosaicAI @mrdrozdov @lateinteraction @sam_havens @mcarbin Welcome Nandan" [X Link](https://x.com/matei_zaharia/status/1825677671164195090) 2024-08-19T23:34Z 42.2K followers, [---] engagements "@DipendraMisra @databricks @DbrxMosaicAI Welcome Dipendra" [X Link](https://x.com/matei_zaharia/status/1827197478300741877) 2024-08-24T04:13Z 42.3K followers, [---] engagements "Building AI judges for real-world apps is hard -- unlike academic benchmarks many of these have long answers in complex domains. Here's how we improved Databricks Agent Eval for these use cases to perform 10% better on customer datasets: https://www.databricks.com/blog/databricks-announces-significant-improvements-built-llm-judges-agent-evaluation https://www.databricks.com/blog/databricks-announces-significant-improvements-built-llm-judges-agent-evaluation" [X Link](https://x.com/matei_zaharia/status/1832094357467677176) 2024-09-06T16:31Z 42.3K followers, [----] engagements "@thomasahle @TAG_News Not really but we have a GitHub org here: https://github.com/tag-research https://github.com/tag-research" [X Link](https://x.com/matei_zaharia/status/1832170510899409390) 2024-09-06T21:34Z 42.3K followers, [---] engagements "AI Gateways are a critical pattern to use LLMs in production allowing you to easily switch between models log events and implement security rate limiting and cost control. We've just updated Databricks AI Gateway with a slew of new features that work across providers and OSS. Thrilled to introduce new updates to #MosaicAI Gateway Simplified secure & governed AI for all your GenAI models. This release adds advanced features in usage tracking payload logging & guardrails to help customers accelerate their AI initiatives. https://t.co/HpOUkNOFHx Thrilled to introduce new updates to #MosaicAI" [X Link](https://x.com/matei_zaharia/status/1833573128523682155) 2024-09-10T18:27Z 42.3K followers, [----] engagements "Really cool to see OpenAI o1 launched today. It's another example of the trend towards compound AI systems not models getting the best AI results. I'm sure that future versions will not only scale inference but also use tools (coding search etc) for better results. Interesting trend in AI: the best results are increasingly obtained by compound systems not monolithic models. AlphaCode ChatGPT+ Gemini are examples. In this post we discuss why this is and emerging research on designing & optimizing such systems. https://t.co/tfnNuoTNNY Interesting trend in AI: the best results are increasingly" [X Link](https://x.com/matei_zaharia/status/1834351621570199819) 2024-09-12T22:01Z 42.2K followers, 18.9K engagements "There are lots of ways to combine models and tools to get better results so it will be interesting to see which ones do best for which tasks. We talked about some of them here: https://bair.berkeley.edu/blog/2024/02/18/compound-ai-systems/ https://bair.berkeley.edu/blog/2024/02/18/compound-ai-systems/" [X Link](https://x.com/matei_zaharia/status/1834351624002875633) 2024-09-12T22:01Z 42.3K followers, [----] engagements "Super excited about the new 1B and 3B Llama models and multimodal Llama The cost-performance of open source AI is improving dramatically and private device-local AI is becoming practical with these models. Proud that @databricks is a launch partner. 📣 Introducing Llama 3.2: Lightweight models for edge devices vision models and more Whats new Llama [---] 1B & 3B models deliver state-of-the-art capabilities for their class for several on-device use cases with support for @Arm @MediaTek & @Qualcomm on day one. https://t.co/lx4N2qGSCe 📣 Introducing Llama 3.2: Lightweight models for edge devices" [X Link](https://x.com/matei_zaharia/status/1839026350415557003) 2024-09-25T19:37Z 42.3K followers, [----] engagements "Super excited by what the team has built with Apps supporting all the major Python frameworks for deploying internal data or AI apps directly from your workspace. Check it out today Introducing Databricks Apps a new way to build internal data + AI applications. Build data visualizations AI applications and self-service analytics directly on the Databricks Data Intelligence Platform. Now in Public Preview on AWS and Azure. https://t.co/QYCPLzbm2t https://t.co/TdY7C45htm Introducing Databricks Apps a new way to build internal data + AI applications. Build data visualizations AI applications and" [X Link](https://x.com/matei_zaharia/status/1843747067937907004) 2024-10-08T20:15Z 42.2K followers, [----] engagements "Our new batch inference offering from @databricks launched today making it easy to get reliable low-cost inference right from SQL. No need to export data to another system or format just call ai_query and we'll automatically scale and mange resources. https://www.databricks.com/blog/introducing-simple-fast-and-scalable-batch-llm-inference-mosaic-ai-model-serving https://www.databricks.com/blog/introducing-simple-fast-and-scalable-batch-llm-inference-mosaic-ai-model-serving" [X Link](https://x.com/matei_zaharia/status/1848840172882039151) 2024-10-22T21:33Z 44.8K followers, [----] engagements "We've expanded our collaboration with Dun & Bradstreet to bring their industry-leading commercial data on hundreds of millions of businesses to the Databricks Marketplace Every Databricks customer can now easily connect to this data. https://sprou.tt/1SN4eUIRS2h https://sprou.tt/1SN4eUIRS2h" [X Link](https://x.com/matei_zaharia/status/1851721879662346642) 2024-10-30T20:24Z 43.5K followers, [----] engagements "You can now use MLflow to log and trace OpenAI Swarm applications. This adds to our support for GenAI tracing and MLOps in LangChain LangGraph LlamaIndex AutoGen and other frameworks giving you a consistent MLOps stack across them. MLflow's OpenAI autologging now includes built-in tracing for OpenAI Swarm multi-agent systems with one line of code: mlflow.openai.autolog() That's all it takes to get full visibility into every agent handoff and tool call. #MLflow #AI #OpenAI https://t.co/fkXFm0rvM1 MLflow's OpenAI autologging now includes built-in tracing for OpenAI Swarm multi-agent systems" [X Link](https://x.com/matei_zaharia/status/1852410224176705618) 2024-11-01T17:59Z 42.3K followers, [----] engagements "Some surprising results on current neural rerankers by @mat_jacob1002 and the Databricks research team It's time to revisit common assumptions in IR Embeddings have improved drastically but mainstream IR evals have stagnated since MSMARCO and BEIR. We ask: on private or tricky IR tasks are current rerankers even better Surely reranking as many docs as you can afford is best https://t.co/sLwCHMH2x6 It's time to revisit common assumptions in IR Embeddings have improved drastically but mainstream IR evals have stagnated since MSMARCO and BEIR. We ask: on private or tricky IR tasks are current" [X Link](https://x.com/matei_zaharia/status/1859298618991411691) 2024-11-20T18:11Z 42.4K followers, 10.5K engagements "@Ahmad_Al_Dahle Congrats on the launch" [X Link](https://x.com/matei_zaharia/status/1865142010774196374) 2024-12-06T21:11Z 42.3K followers, [---] engagements "Congrats to the Meta team on Llama [---]. Open weight models are advancing so rapidly and the cost to get this performance is quickly going down. We're thrilled to let users serve and customize this on @databricks starting next week. Introducing Llama [---] a new 70B model that delivers the performance of our 405B model but is easier & more cost-efficient to run. By leveraging the latest advancements in post-training techniques including online preference optimization this model improves core performance at https://t.co/6oQ7b3Yuzc Introducing Llama [---] a new 70B model that delivers the" [X Link](https://x.com/matei_zaharia/status/1865142519199338872) 2024-12-06T21:13Z 42.4K followers, [----] engagements "This is a big launch for our AI agent platform -- making it easier to create high quality evaluations which is often the bottleneck for improving agents. Our researchers and engineers collaborated to automatically generate high-quality questions and provide a great curation UI. Introducing new synthetic data capabilities in Mosaic AI Agent Evaluation. Now developers can create high-quality evaluation data sets based on their proprietary data in just minutes without being bottlenecked by SMEs. How to get started👇https://t.co/rbFVoGfJaS Introducing new synthetic data capabilities in Mosaic AI" [X Link](https://x.com/matei_zaharia/status/1866226471867674940) 2024-12-09T21:00Z 42.4K followers, [----] engagements "Congrats to these awesome startups @vevo_ai @OrbyAI @ChipStackAI Announcing the winners of the Databricks #GenerativeAI Startup Challenge - Grand Prize: @vevo_ai - Second Place: @OrbyAI - Third Place: @ChipStackAI - Honorable Mention: Flagler Health Were thrilled to see their continued growth and impact https://t.co/qD4jtDhwCH https://t.co/zQdmodRPXX Announcing the winners of the Databricks #GenerativeAI Startup Challenge - Grand Prize: @vevo_ai - Second Place: @OrbyAI - Third Place: @ChipStackAI - Honorable Mention: Flagler Health Were thrilled to see their continued growth and impact" [X Link](https://x.com/matei_zaharia/status/1866912206702707094) 2024-12-11T18:25Z 42.4K followers, [----] engagements Limited data mode. Full metrics available with subscription: lunarcrush.com/pricing
@matei_zaharia Matei Zaharia
Matei Zaharia posts on X about databricks, ai, data ai summit, compound the most. They currently have [------] followers and [---] posts still getting attention that total [-----] engagements in the last [--] hours.
Engagements: [-----] #
- [--] Week [-----] -72%
- [--] Month [------] -38%
- [--] Months [-------] +237%
- [--] Year [-------] -51%
Mentions: [--] #
- [--] Month [--] -78%
- [--] Months [--] -7.10%
- [--] Year [--] -53%
Followers: [------] #
- [--] Week [------] +0.13%
- [--] Month [------] +0.59%
- [--] Months [------] +5%
- [--] Year [------] +8.80%
CreatorRank: [---------] #
Social Influence
Social category influence technology brands events stocks finance travel destinations fashion brands countries
Social topic influence databricks, ai, data ai summit, compound, build, llm, systems, agentic, the first, san jose
Top accounts mentioned or mentioned by @databricks @dataaisummit @dbrxmosaicai @mlflow @aidotengineer @apachespark @aiatmeta @caisconf @chenlingjiao @lmthang @lateinteraction @naveengrao @jefrankle @neondatabase @gartnerinc @dawnsongtweets @istoica05 @monicaslam @deltalakeoss @googlecloud
Top assets mentioned Alphabet Inc Class A (GOOGL) Cloudflare, Inc. (NET) ACM Research, Inc. Class A Common Stock (ACMR) IBM (IBM) INTESA SANPAOLO (ISNPY) Dell Technologies, Inc. (DELL) Microsoft Corp. (MSFT)
Top Social Posts
Top posts by engagements in the last [--] hours
"Super excited to announce MLflow a new open source Machine Learning platform from Databricks to manage the complete machine learning lifecycle: https://databricks.com/blog/2018/06/05/introducing-mlflow-an-open-source-machine-learning-platform.html https://databricks.com/blog/2018/06/05/introducing-mlflow-an-open-source-machine-learning-platform.html"
X Link 2018-06-05T18:04Z 46.2K followers, [---] engagements
"@cutting Just means that even though it can talk to Databricks cloud product additional terms of use apply to that product. But you dont have to use that part"
X Link 2018-06-06T02:24Z 46.2K followers, [--] engagements
"I gave a keynote at @ACMSoCC about lessons from building a large-scale cloud service at @Databricks. Did you know that Databricks runs millions of VMs/day to process exabytes of data with [---] engineers Slides here: https://www.slideshare.net/matei/lessons-from-largescale-cloud-software-at-databricks https://www.slideshare.net/matei/lessons-from-largescale-cloud-software-at-databricks"
X Link 2019-11-22T00:24Z 45.3K followers, [---] engagements
"#DataAISummit Call for Presentations ends Jan [--] Submit your case studies research or best practices around #Lakehouse MLOps streaming and data. Last year's event included [-----] data experts. http://dbricks.co/3Wh1Mx6 http://dbricks.co/3Wh1Mx6"
X Link 2023-01-11T17:51Z 46.1K followers, 15.9K engagements
"Want to build your own chat AI from scratch We're launching a Building LLMs course at @Data_AI_Summit to teach everyone how to build a Dolly clone: Tiny model big attitude for anyone. #DemocratizeAI https://www.databricks.com/dataaisummit https://www.databricks.com/dataaisummit"
X Link 2023-03-31T17:50Z 46K followers, 28.5K engagements
"Some nice goodies for in-person attendees of @Data_AI_Summit this year. Register here: https://www.databricks.com/dataaisummit/ https://www.databricks.com/dataaisummit/"
X Link 2023-04-24T19:14Z 46K followers, 10.9K engagements
"Really excited to have @lqiao as a keynote speaker at @Data_AI_Summit: 💪 Co-creator of @PyTorch 🌟 Co-founder and CEO Fireworks 🧠 #AI expert Ph.D. Hear from her and other data and AI leaders this June: https://www.databricks.com/dataaisummit/ https://www.databricks.com/dataaisummit/"
X Link 2023-04-30T05:15Z 46K followers, [----] engagements
"Submit your talks to #DataAISummit now to reach tens of thousands of practitioners and execs The conference will be in San Francisco next June. Calling all Data + AI Innovators https://t.co/0k6bivJJGE #DataAISummit [----] is your chance to showcase your work to 70000+ peers 🌎 Share insights on: ✔ Real-time data streaming ✔ Deep learning & ML ✔ BI and SQL analytics ✔ & more https://t.co/45sH1m4rju Calling all Data + AI Innovators https://t.co/0k6bivJJGE #DataAISummit [----] is your chance to showcase your work to 70000+ peers 🌎 Share insights on: ✔ Real-time data streaming ✔ Deep learning & ML ✔"
X Link 2024-11-28T18:46Z 46K followers, [----] engagements
"@PaulLockettkpb @databricks Thanks fixed them"
X Link 2025-06-11T19:14Z 45.4K followers, [--] engagements
"Prompt optimization is becoming a powerful technique for improving AI that can even beat SFT Here are some of our research results with GEPA at Databricks in difficult Agent Bricks info extraction tasks. We can match the best models at 90x lower cost or improve them by 6%"
X Link 2025-09-25T03:59Z 45.4K followers, 106.2K engagements
"We've invested a lot in agent evaluation in MLflow and made it super easy to get high quality judges. Our new make_judge judges can take declarative instructions analyze entire traces from any agent framework and align their ratings with human feedback. https://mlflow.org/blog/custom-llm-judges-make-judge https://mlflow.org/blog/custom-llm-judges-make-judge"
X Link 2025-10-09T00:01Z 45.6K followers, 11.7K engagements
"My team is hiring AI research interns for summer [----] at Databricks Join us to learn about AI use cases at thousands of companies and contribute to making it easier for anyone to build specialized AI agents and models for difficult tasks"
X Link 2025-10-17T18:18Z 45.9K followers, 121.1K engagements
"Specific focus areas include scalable RL training multimodal models information retrieval evaluation and coding and data science agents. Apply here: https://www.databricks.com/company/careers/university-recruiting/phd-genai-research-scientist-intern-7011263002 https://www.databricks.com/company/careers/university-recruiting/phd-genai-research-scientist-intern-7011263002"
X Link 2025-10-17T18:18Z 45.3K followers, [----] engagements
"Fine-tuned (PEFT/LoRA) models can greatly improve quality but serving them can be challenging due to both numerical and performance issues. Our team has done amazing work to get up to 2x higher throughput and 2-3% better quality than open source engines: https://www.databricks.com/blog/fast-peft-serving-scale https://www.databricks.com/blog/fast-peft-serving-scale"
X Link 2025-10-21T22:21Z 45.4K followers, [----] engagements
"This is a big deal -- ingest data into any lakehouse table with no infra setup just calling a REST API. Simple efficient and powerful. Announcing Public Preview of Zerobus Ingest part of Lakeflow Connect: Push event data directly into your lakehouseno message bus required Simplified ingestion. Reduced latency. Built for scale. - Up to [---] MB/sec per connection - Latency as low as [--] seconds - Native Delta + https://t.co/ozlYjgBfKo Announcing Public Preview of Zerobus Ingest part of Lakeflow Connect: Push event data directly into your lakehouseno message bus required Simplified ingestion."
X Link 2025-10-30T19:57Z 45.4K followers, [----] engagements
"Enterprise documents are very complex with tables headings figures etc and the new ai_parse_document identifies these components reliably and returns them in a JSON form for downstream apps/agents. Customers have been putting it to the test on some very tough datasets"
X Link 2025-11-11T19:17Z 45.5K followers, [----] engagements
"We also made it super easy to use from SQL or Apache Spark. Just call ai_parse_document and we automatically handle batch execution at scale. Docs here: https://docs.databricks.com/aws/en/sql/language-manual/functions/ai_parse_document https://docs.databricks.com/aws/en/sql/language-manual/functions/ai_parse_document"
X Link 2025-11-11T19:17Z 45.5K followers, [----] engagements
"@tasso @databricks Super excited to work together Tasso"
X Link 2025-11-12T02:52Z 45.5K followers, [---] engagements
"Congrats to all the database product teams at Databricks for this great recognition Were proud to share that Databricks has been named a Leader in the [----] @Gartner_inc Magic Quadrant for Cloud Database Management Systems for the fifth year in a row The Databricks Platform enables everyone in your organization to use data and AI. New innovations like Agent https://t.co/IwAXTdPEcD Were proud to share that Databricks has been named a Leader in the [----] @Gartner_inc Magic Quadrant for Cloud Database Management Systems for the fifth year in a row The Databricks Platform enables everyone in your"
X Link 2025-11-21T19:42Z 45.6K followers, [----] engagements
"If you're at #NeurIPS check out Erich Elsen's talk at 5:15 today on a new AI benchmark competition we created at @Databricks for economically valuable tasks where frontier model still struggle significantly. https://neurips.cc/virtual/2025/loc/san-diego/talk/127768 https://neurips.cc/virtual/2025/loc/san-diego/talk/127768"
X Link 2025-12-02T16:48Z 45.8K followers, [----] engagements
"LLMs are claimed to reach PhD intelligence but still fail mundane tasks. To understand this challenge Databricks launched OfficeQA a benchmark of useful tasks that require reliability&diligence not specialized knowledge. We're also doing a competition https://www.databricks.com/blog/introducing-officeqa-benchmark-end-to-end-grounded-reasoning https://www.databricks.com/blog/introducing-officeqa-benchmark-end-to-end-grounded-reasoning"
X Link 2025-12-09T22:36Z 45.9K followers, 26K engagements
"Great to see GPT-5.2 come out today We also found it to do better than past frontier models on OfficeQA though there is still a lot of headroom for AI to do well on this benchmark. Were excited to share that our customers have day-one access to OpenAI GPT-5.2 on Databricks GPT-5.2 delivers strong gains on OfficeQA our benchmark for grounded enterprise reasoning and is now available on our platform with native Response API support. Paired with Agent https://t.co/45C0mr8VVv Were excited to share that our customers have day-one access to OpenAI GPT-5.2 on Databricks GPT-5.2 delivers strong gains"
X Link 2025-12-11T18:51Z 45.9K followers, 14.5K engagements
"People often ask me why we think Databricks can succeed in new areas we expand to. This is the recipe why: we build stellar teams in areas where we think we can greatly improve on the status quo. Lakehouse was one Lakebase is next but there's more coming especially in AI. We disclosed today as part of our Series L that our 4-yr old data warehousing business is now $1B revenue run rate. This is to the best of my knowledge the fastest to $1B DW product in the industry. How did we do it and whats next The conventional wisdom is that it would We disclosed today as part of our Series L that our"
X Link 2025-12-17T05:44Z 46K followers, 37.6K engagements
"I'm thrilled to be co-organizing a new ACM research Conference on Agentic & AI Systems (CAIS) this spring It's the first conference focused solely on this field. 📍San Jose May 26-29 [----] 🗓Paper deadline Feb 27th Follow @CAISconf for updates http://caisconf.org http://caisconf.org"
X Link 2025-12-23T17:50Z 46.1K followers, 34.8K engagements
"CAIS is organized by a great steering and organizing committee including @heathercmiller @jaredq_ @deeptir18 @ChenLingjiao @JeffDean @lmthang @gneubig @pirroh @dawnsongtweets @istoica05 @lateinteraction @MonicaSLam @ChrisGPotts @NaveenGRao. Submit your papers & workshops in Feb"
X Link 2025-12-23T17:50Z 45.9K followers, [----] engagements
"Dicer is a statue of the art reliable autosharder that can power a wide range of stateful services. You can find it on GitHub at https://github.com/databricks/dicer https://github.com/databricks/dicer"
X Link 2026-01-13T23:59Z 46.1K followers, [----] engagements
"Agent memory is a simple and powerful way to do continual learning With the new MemAlign method from Databricks Research we can build better LLM judges from examples of human ratings and they scale with more data. Now in Databricks and @MLflow. https://www.databricks.com/blog/memalign-building-better-llm-judges-human-feedback-scalable-memory https://www.databricks.com/blog/memalign-building-better-llm-judges-human-feedback-scalable-memory"
X Link 2026-02-04T17:57Z 46.4K followers, 17.7K engagements
"At Databricks we've built an awesome model training and tuning stack. We now used it to release DBRX the best open source LLM on standard benchmarks to date exceeding GPT-3.5 while running 2x faster than Llama-70B. https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm"
X Link 2024-03-27T13:01Z 46.4K followers, 129.8K engagements
"Really cool -- looks like system design and prompts can have more impact than foundation model weight training past some point. Our IMO gold medal-winning AI pipeline is now model-agnostic. 🥇 What worked for Gemini [---] Pro now gets the same 5/6 score with GPT-5 & Grok4. This confirms the power of our verification-and-refinement pipeline to improve base model capabilities. The new code & results are Our IMO gold medal-winning AI pipeline is now model-agnostic. 🥇 What worked for Gemini [---] Pro now gets the same 5/6 score with GPT-5 & Grok4. This confirms the power of our"
X Link 2025-08-27T20:06Z 46.4K followers, [----] engagements
"If you're running agents in production consider taking this short survey from my research group We're collaborating with IBM Stanford UIUC Intesa Sanpaolo and others to better understand the challenges in building agents. It only takes [--] minutes: https://agents-survey.github.io/AI-Agent-Survey/participate/ https://agents-survey.github.io/AI-Agent-Survey/participate/"
X Link 2025-08-27T20:55Z 46.4K followers, 35.4K engagements
"Great new capability in Databricks powered by our AI research team We trained a document parsing system that delivers leading quality at 3-5x lower cost and outperforms leading VLMs like GPT-5 and Claude. This is critical to connect AI to so many kinds of data. 80% of enterprise data is unstructured locked in PDFs reports and diagrams that traditional tools cant parse or govern. Introducing ai_parse_document state-of-the-art document intelligence on Databricks. With a single SQL command teams can now turn any document into https://t.co/UNNyWqPJoo 80% of enterprise data is unstructured locked"
X Link 2025-11-11T19:17Z 46.2K followers, 33.8K engagements
"Super excited that were open sourcing the Dicer autosharder Its become a critical piece of infrastructure in Databricks thats made many of our systems more scalable and reliable and its powered by really cool systems work. https://www.databricks.com/blog/open-sourcing-dicer-databricks-auto-sharder https://www.databricks.com/blog/open-sourcing-dicer-databricks-auto-sharder"
X Link 2026-01-13T23:59Z 46.4K followers, 17.7K engagements
"Lakebase is GA We think this is going to make it radically simpler and more reliable to work with online databases. You can instantly branch your DB take snapshots roll back to a point in time or create a copy for offline analysis whether it's humans or AI doing the work. Operational databases have long relied on tightly coupled compute and storage. This architecture creates resource contention and pushes teams to manage infrastructure rather than build. As applications become more real time and automated the transactional layer needs to adapt. https://t.co/BE2TAysLrX Operational databases"
X Link 2026-02-03T23:27Z 46.4K followers, 13.1K engagements
"Agentic Data Quality Monitoring is now in public preview on @Databricks powered by Unity Catalog This next generation of monitoring looks at how your data is used to automatically flag the most important issues without needing manual rules & thresholds. https://www.databricks.com/blog/data-quality-monitoring-scale-agentic-ai https://www.databricks.com/blog/data-quality-monitoring-scale-agentic-ai"
X Link 2026-02-05T17:22Z 46.4K followers, [----] engagements
"ACM CAIS is a the first research conference focused on agentic and AI systems and will run in San Jose this year. The deadline is coming up Feb 27th submit your papers here: https://www.caisconf.org/ https://www.caisconf.org/"
X Link 2026-02-06T04:01Z 46.4K followers, [----] engagements
"Very excited about this opportunity for CAIS paper authors to also present at @aiDotEngineer World's Fair Excited to share that this years @aiDotEngineer Worlds Fair will be the first to offer industry spotlight awards for peer reviewed papers and we are setting aside poster sessions to feature the best industry-impacting research of [----]. Please submit and we very much look https://t.co/4SuDQRN2mk Excited to share that this years @aiDotEngineer Worlds Fair will be the first to offer industry spotlight awards for peer reviewed papers and we are setting aside poster sessions to feature the"
X Link 2026-02-10T18:43Z 46.4K followers, [----] engagements
"Spark + AI Summit [----] videos are now up at https://databricks.com/sparkaisummit/sessionseventName=Summit%202018 https://databricks.com/sparkaisummit/sessionseventName=Summit%202018"
X Link 2018-06-21T17:12Z 42.2K followers, [---] engagements
"Slides from our first #MLflow meetup last week: https://www.slideshare.net/databricks/introduction-fo-mlflow https://www.slideshare.net/databricks/introduction-fo-mlflow"
X Link 2018-06-30T16:12Z 42.3K followers, [---] engagements
"Databricks Ion Stoica presenting the unified analytics platform for genomics to kick off the second day of #SparkAISummit London"
X Link 2018-10-04T08:15Z 42.3K followers, [--] engagements
"#ApacheSpark [---] is out today This release has tons of new features including barrier execution mode for ML applications higher-order functions in SQL optional eager evaluation for previewing DataFrames in Jupyter Scala [----] support and more. https://spark.apache.org/releases/spark-release-2-4-0.html https://spark.apache.org/releases/spark-release-2-4-0.html"
X Link 2018-11-08T19:23Z 42.3K followers, [---] engagements
"Super excited to have Katie Bouman speaking at #SparkAISummitEurope this October We're pleased to announce that Katie Bouman will be a keynote speaker at #SparkAISummit Europe Register now to hear how she developed a #machinelearning algorithm to capture the first picture of a black hole: https://t.co/jj9iG9wld4 https://t.co/8Ke2m3UjjW We're pleased to announce that Katie Bouman will be a keynote speaker at #SparkAISummit Europe Register now to hear how she developed a #machinelearning algorithm to capture the first picture of a black hole: https://t.co/jj9iG9wld4 https://t.co/8Ke2m3UjjW"
X Link 2019-07-31T16:30Z 42.3K followers, [--] engagements
"Some fun with @Databricks interns at minigolf. Were hiring interns in both SF and Amsterdam for next year: https://databricks.com/company/careersgh_jid=4374189002 https://databricks.com/company/careersgh_jid=4374189002"
X Link 2019-08-03T02:19Z 42.2K followers, [--] engagements
"Nice case study from HyperloopOne about running pandas code on #ApacheSpark with the new Koalas library: No more complex rewrite into Spark DataFrames needed. https://databricks.com/blog/2019/08/22/guest-blog-how-virgin-hyperloop-one-reduced-processing-time-from-hours-to-minutes-with-koalas.html https://databricks.com/blog/2019/08/22/guest-blog-how-virgin-hyperloop-one-reduced-processing-time-from-hours-to-minutes-with-koalas.html"
X Link 2019-08-22T20:15Z 42.2K followers, [--] engagements
"I'm also excited to speak about #MLflow at the Data Engineering Meetup in Berlin on Oct 21st. Thanks @Zalando for hosting this event: https://www.meetup.com/Zalando-Tech-Events-Berlin/events/265207361/_xtd=gqFyqTE0OTEwODg4MqFwp2FuZHJvaWQ&from=ref https://www.meetup.com/Zalando-Tech-Events-Berlin/events/265207361/_xtd=gqFyqTE0OTEwODg4MqFwp2FuZHJvaWQ&from=ref"
X Link 2019-09-30T06:33Z 42.3K followers, [--] engagements
"Databricks is proud to be sponsoring the #MLSys research conference this year. Drop by our booth to hear about jobs building large-scale ML platforms -- we run ML and data workloads for over [----] customers processing exabytes of data per day"
X Link 2020-03-02T20:55Z 42.2K followers, [--] engagements
"One of my favorite features in the upcoming #ApacheSpark [---] is Adaptive Query Execution (AQE) which tunes number of reduce tasks join algorithms and skew joins automatically. Learn how it works and how it speeds up TPC-DS queries by up to 8x: https://databricks.com/blog/2020/05/29/adaptive-query-execution-speeding-up-spark-sql-at-runtime.html https://databricks.com/blog/2020/05/29/adaptive-query-execution-speeding-up-spark-sql-at-runtime.html"
X Link 2020-05-29T18:35Z 42.2K followers, [---] engagements
"#SparkAISummit will include some truly large-scale data and AI use cases. One highlight is this talk from Apple's Dom Brezinski on one of the earliest and largest uses of #DeltaLake processing 100s of TBs of network events / day for information security: https://databricks.com/session_na20/patterns-and-operational-insights-from-the-first-users-of-delta-lake https://databricks.com/session_na20/patterns-and-operational-insights-from-the-first-users-of-delta-lake"
X Link 2020-06-22T18:22Z 42.3K followers, [--] engagements
"Several cakes were harmed in the making of this conference Lesson #2 on running a virtual conference: Nail the transitions It's easy to hand the clicker to your peer onstage but we had to get creative with #SparkAISummit. Sharing a cake Snapping a finger There's no limit when you're sharing a virtual stage https://t.co/iIzkNB6Xbo Lesson #2 on running a virtual conference: Nail the transitions It's easy to hand the clicker to your peer onstage but we had to get creative with #SparkAISummit. Sharing a cake Snapping a finger There's no limit when you're sharing a virtual stage"
X Link 2020-07-10T17:04Z 42.3K followers, [--] engagements
"For @VLDB2020 we wrote a paper on @DeltaLakeOSS one of the most exciting new technologies from Databricks. By adding ACID transactions over cloud object stores we can provide data-warehouse-like capabilities & performance on low-cost HA cloud storage. https://databricks.com/wp-content/uploads/2020/08/p975-armbrust.pdf https://databricks.com/wp-content/uploads/2020/08/p975-armbrust.pdf"
X Link 2020-08-22T17:46Z 44.8K followers, [---] engagements
"Some nice ongoing work to make it easier to ship various kinds of #Python environments with @ApacheSpark applications as part of Project Zen: https://databricks.com/blog/2020/12/22/how-to-manage-python-dependencies-in-pyspark.html https://databricks.com/blog/2020/12/22/how-to-manage-python-dependencies-in-pyspark.html"
X Link 2020-12-23T16:39Z 42.3K followers, [--] engagements
"Starting soon Only [--] days left to register for our #MLOps virtual event Join us to learn about: 🖥 Best practices to operationalize #ML at scale 💪 Customer success stories 🙋 Live Q&A .and so much more https://t.co/DVupn6wCvz Only [--] days left to register for our #MLOps virtual event Join us to learn about: 🖥 Best practices to operationalize #ML at scale 💪 Customer success stories 🙋 Live Q&A .and so much more https://t.co/DVupn6wCvz"
X Link 2021-02-09T17:11Z 42.3K followers, [--] engagements
"Databricks is now available on @googlecloud We've also built great integrations with BigQuery Looker GCS and Google AI services across the product. Open #lakehouse platform meets open #cloud with unified data engineering data science and analytics. Learn more about Databricks on @GoogleCloud: https://t.co/2ACwHl2SCK https://t.co/MTI5SbWnRS Open #lakehouse platform meets open #cloud with unified data engineering data science and analytics. Learn more about Databricks on @GoogleCloud: https://t.co/2ACwHl2SCK https://t.co/MTI5SbWnRS"
X Link 2021-02-17T15:22Z 42.3K followers, [---] engagements
"There are a lot of nice updates to Structured Streaming in @ApacheSpark [---] including new types of stream-stream joins better UI easier SQL integration by registering streams as tables and better @ApacheKafka and file data sources: https://databricks.com/blog/2021/04/27/whats-new-in-apache-spark-3-1-release-for-structured-streaming.html https://databricks.com/blog/2021/04/27/whats-new-in-apache-spark-3-1-release-for-structured-streaming.html"
X Link 2021-04-28T16:41Z 42.3K followers, [--] engagements
"We're thrilled to launch #DeltaSharing an open protocol for secure data sharing between different computing platforms at #Data_AI_Summit today Databricks is working on this with a big ecosystem of partners including the top cloud BI and data vendors. https://databricks.com/blog/2021/05/26/introducing-delta-sharing-an-open-protocol-for-secure-data-sharing.html https://databricks.com/blog/2021/05/26/introducing-delta-sharing-an-open-protocol-for-secure-data-sharing.html"
X Link 2021-05-26T16:08Z 42.3K followers, [---] engagements
"Databricks just set a new record on the official TPC-DS data warehousing benchmark showing that a lakehouse system based on open data formats can outperform previous DW systems. Don't listen to folks who say open means bad performance https://databricks.com/blog/2021/11/02/databricks-sets-official-data-warehousing-performance-record.html https://databricks.com/blog/2021/11/02/databricks-sets-official-data-warehousing-performance-record.html"
X Link 2021-11-02T16:25Z 42.2K followers, [---] engagements
"Finally got to meet the cardboard cutout of me that someone put in the @Databricks Singapore office. It's a fun and fast-growing office #GovTechSTACK #DestinationLakehouse"
X Link 2022-11-15T15:17Z 42.3K followers, [--] engagements
"ChatGPT is super cool but it can still get facts very wrong like this example we used in [----] It even generates a second wrong fact (not named after governor). LLMs probably need to use tools like retrieval to avoid being BS-as-a-service. https://hai.stanford.edu/news/moderate-proposal-radically-better-ai-powered-web-search https://hai.stanford.edu/news/moderate-proposal-radically-better-ai-powered-web-search"
X Link 2022-12-02T19:05Z 42.2K followers, [---] engagements
"We've just launched a version of Dolly on HuggingFace with new examples showing its capabilities. This is all with just 50k training examples. Stay tuned for new versions with other datasets soon. https://huggingface.co/databricks/dolly-v1-6b https://huggingface.co/databricks/dolly-v1-6b"
X Link 2023-03-30T16:06Z 42.3K followers, 107.7K engagements
"Very cool to see Dolly-v2 hit #1 trending on HuggingFace Hub today. Stay tuned for a lot more LLM infra coming from Databricks soon. And register for our @Data_AI_Summit conference to hear the biggest things as they launch -- online attendance is free"
X Link 2023-04-13T05:31Z 42.3K followers, 48.3K engagements
"Want to build your own conversational AI from open datasets and your own data Join this free webinar on April 25th with some of the Dolly authors: https://www.databricks.com/resources/webinar/build-your-own-large-language-model-dolly https://www.databricks.com/resources/webinar/build-your-own-large-language-model-dolly"
X Link 2023-04-14T18:24Z 42.3K followers, 27.6K engagements
"Databricks just published our #StateofDataAI report with interesting trends at our enterprise customers: [--]. Adoption of LLMs is booming with use of SaaS LLM APIs exploding since #ChatGPT launched but the largest use (and growth) still in custom LLMs. https://www.databricks.com/discover/state-of-data-ai https://www.databricks.com/discover/state-of-data-ai"
X Link 2023-05-23T16:21Z 42K followers, 70.2K engagements
"I'm thrilled to host a panel with four amazing AI faculty at @Data_AI_Summit: Daniela Rus @dawnsongtweets @mcarbin and @percyliang. They're leading some of the top labs in AI that have enabled today's systems so I'm excited to see what they say about the future"
X Link 2023-06-01T22:48Z 42K followers, [----] engagements
"#MLflow [---] was released today with new tools for LLMOps including visual comparison and programmatic evaluation. We also added a new Evaluation Datasets concept useful in any kind of MLOps workflow. Check it out: https://www.databricks.com/blog/announcing-mlflow-24-llmops-tools-robust-model-evaluation https://www.databricks.com/blog/announcing-mlflow-24-llmops-tools-robust-model-evaluation"
X Link 2023-06-07T23:26Z 41.4K followers, 15.5K engagements
"Very excited about [--] new partners in the #DeltaSharing open ecosystem: - @Cloudflare R2 to let providers deliver data with no egress fees - @Twilio for accessing data from any compute system - @Oracle and @Dell for access to their DB and storage offerings https://sprou.tt/1m5NmM246t8 https://sprou.tt/1m5NmM246t8"
X Link 2023-06-20T19:52Z 41.5K followers, 10.2K engagements
"Data+AI Summit keynotes are starting soon Tune in online for free at https://www.databricks.com/dataaisummit/ https://www.databricks.com/dataaisummit/"
X Link 2023-06-28T15:16Z 42K followers, 11.6K engagements
"Meet #LakehouseIQ: a knowledge engine from your enterprise that understands your business & data to power AI apps. Every platform is adding an AI assistant but in data LLMs don't just work out of the box because every org has its own jargon data etc. https://www.databricks.com/blog/introducing-lakehouseiq-ai-powered-engine-uniquely-understands-your-business https://www.databricks.com/blog/introducing-lakehouseiq-ai-powered-engine-uniquely-understands-your-business"
X Link 2023-06-28T16:38Z 42K followers, 46.5K engagements
"We're incorporating LakehouseIQ into all Databricks UIs and making it available as an API to power your own internal Generative AI applications. We think this type of engine will be a new pillar in the enterprise software stack"
X Link 2023-06-28T16:38Z 37.3K followers, [--] engagements
"Huge launch today: with #LakehouseFederation you can use now Databricks to query and manage data in any system. Whether you want to build a #DataMesh or just give people access to data faster you get a single place for your users data ETL AI and BI"
X Link 2023-06-28T19:17Z 36.2K followers, [--] engagements
"One of my favorite announcements: English SDK for @ApacheSpark No more need to remember weird syntax just chain transformations in natural language with the familiar Spark API. So many fun examples. https://www.databricks.com/blog/introducing-english-new-programming-language-apache-spark https://www.databricks.com/blog/introducing-english-new-programming-language-apache-spark"
X Link 2023-06-29T17:54Z 42K followers, 74.4K engagements
"More details on UniForm which lets you read & write @DeltaLakeOSS tables as Apache Iceberg or Hudi. The whole point of open formats is interop so why were vendors creating these boundaries in support when 99.9% of the base data underneath is Parquet"
X Link 2023-06-29T21:27Z 37.3K followers, [----] engagements
"Here's our 1-minute demo of Delta Lake [---] universal format: reading a Delta table as Iceberg in #bigquery. This means @googlecloud BigQuery customers can now combine it with Databricks and other ecosystem software to reduce their ETL costs run AI etc"
X Link 2023-06-30T17:49Z 37.3K followers, [--] engagements
"Great post on being a product manager at Databricks. Were hiring in a number of areas"
X Link 2023-07-14T15:42Z 36.2K followers, [----] engagements
"We're very excited to be one of the launch partners for Meta's Llama [--] 🦙 We got to test Llama [--] in advance and were very impressed. The new version also has a much more permissive license. We've set everything up so you can run it on Databricks today"
X Link 2023-07-18T19:00Z 36.2K followers, 49.7K engagements
"Lots of people are wondering whether #GPT4 and #ChatGPT's performance has been changing over time so Lingjiao Chen @james_y_zou and I measured it. We found big changes including some large decreases in some problem-solving tasks:"
X Link 2023-07-19T00:56Z 37.3K followers, 1.8M engagements
"Welcome to @Databricks @MosaicML👋 MosaicML built an amazing product and team. Together we'll make it dramatically easier for enterprises to build control and customize AI for their use cases. A bit on why we're excited about the acquisition:"
X Link 2023-07-19T20:43Z 36.2K followers, 11.4K engagements
"@stevesi @simonw The "drift" was in GPT-4's response to the "think step-by-step" instruction which the post you quoted reproduced. That post found that GPT-4 was bad at arithmetic too which we didn't notice but chain-of-thought is effective on other tasks and gets ignored now. Their text:"
X Link 2023-07-22T02:45Z 37.3K followers, [---] engagements
"As we worked with customers using LLMs a common pattern we saw was that everyone wanted to add a layer in front of the LLM API to manage credentials rate limits etc and to easily swap between models. We've built this the open source @MLflow AI Gateway: https://www.databricks.com/blog/announcing-mlflow-ai-gateway https://www.databricks.com/blog/announcing-mlflow-ai-gateway"
X Link 2023-07-25T16:46Z 41.5K followers, 32.8K engagements
"Lakehouse Federation on @databricks is now in Public Preview You can connect a wide range of databases in our catalog to give users a central place to query combine and govern them"
X Link 2023-07-28T17:49Z 36.2K followers, [----] engagements
"Our new MOOC on #LLM Foundation Models from the Ground Up is now available Join me Chengyin Eng @sjraymond Joseph Bradley and @abhi_venigalla for a detailed look at how LLMs are built how to improve them and where the field is going. https://www.edx.org/learn/computer-science/databricks-large-language-models-foundation-models-from-the-ground-up https://www.edx.org/learn/computer-science/databricks-large-language-models-foundation-models-from-the-ground-up"
X Link 2023-08-15T18:52Z 42K followers, 43.7K engagements
"This is a big release: we've spent the past [--] years working on LLM pipelines and retrieval-augmented apps in my group and came up with this rich programming model based on our learnings. It not only defines but automatically optimizes pipelines for you to get great results"
X Link 2023-08-24T18:36Z 37.3K followers, 17.2K engagements
"Really excited about this work to combine #FeatureStore + #UnityCatalog on @Databricks. Why have a separate catalog for ML data A unified catalog enables powerful workflows across data and ML engineering. https://sprou.tt/1zW3pHQVDzD https://sprou.tt/1zW3pHQVDzD"
X Link 2023-08-29T18:14Z 41.5K followers, [----] engagements
"How can you efficiently evaluate RAG-based LLM applications like document question answering We've tested several methods on our internal question answering applications at Databricks and found some effective ways to do this using LLMs. https://sprou.tt/1ONB5nHrOlY https://sprou.tt/1ONB5nHrOlY"
X Link 2023-09-13T18:01Z 41.5K followers, 53.9K engagements
"Optimized LLM serving is now in public preview on @databricks Heres how to get low-latency highly available serving for your favorite LLMs including #Llama2 and #MPT across clouds:"
X Link 2023-09-28T21:24Z 36.4K followers, [----] engagements
"We've launched some great industry-specific solution accelerators on Databricks Marketplace with @CleanlabAI @Graphistry and @JohnSnowLabs. Check out these free resources with notebooks and sample data for healthcare cybersecurity & communications"
X Link 2023-10-22T18:50Z 36.4K followers, [----] engagements
"@ArcionLabs @databricks Congrats and welcome"
X Link 2023-10-23T17:25Z 36.3K followers, [---] engagements
"Really cool use case where MetaDialog built the best Arabic-language dataset for LLMs and a state-of-the-art model for advanced RAG in their domain. We're seeing many companies get fantastic results as they customize and extend LLMs for their application"
X Link 2023-10-27T20:09Z 36.3K followers, 11.2K engagements
"Thrilled to receive this award; the credit is due to my students my mentors my collaborators in academia and open source and my colleagues at Databricks for making all this work happen The [----] @ACMSIGOPS Mark Weiser was presented to @matei_zaharia for innovation and impact in large-scale data processing. The award was announced at @sospconf From next year awards will be announced annually as @sospconf is now an annual conference. See you in #austin in [----] The [----] @ACMSIGOPS Mark Weiser was presented to @matei_zaharia for innovation and impact in large-scale data processing. The award was"
X Link 2023-10-29T18:21Z 41.5K followers, 78.6K engagements
"MLflow [---] is out today with new support for LLM-based eval metrics among other features. Read about how we've been using it to improve our RAG apps at Databricks like our docs assistant: https://www.databricks.com/blog/announcing-mlflow-28-llm-judge-metrics-and-best-practices-llm-evaluation-rag-applications-partutm_source=twitter&utm_medium=organic-social https://www.databricks.com/blog/announcing-mlflow-28-llm-judge-metrics-and-best-practices-llm-evaluation-rag-applications-partutm_source=twitter&utm_medium=organic-social"
X Link 2023-10-31T21:12Z 41.6K followers, 37K engagements
"Not saying its the data but congrats Rangers on an amazing season The @Rangers are the champions HUGE congrats on an incredible #WorldSeries win The Rangers are constantly finding new ways to leverage data and AI in its strategy - a big role model for other teams. Were so proud to support these innovations https://t.co/vNZtuWemPz https://t.co/gaPphaVm9u The @Rangers are the champions HUGE congrats on an incredible #WorldSeries win The Rangers are constantly finding new ways to leverage data and AI in its strategy - a big role model for other teams. Were so proud to support these innovations"
X Link 2023-11-02T05:32Z 41.6K followers, 19.1K engagements
"How will generative AI change data platforms We argue that the impact will be fundamental not incremental through a new generation of platforms that deeply understand the content of the data (Data Intelligence Platforms)"
X Link 2023-11-15T23:50Z 36.6K followers, 11.8K engagements
"Very excited about this work started during Jon's research internship at @Databricks. We're hiring research interns for next year now in RAG RLHF model training efficient ML and more"
X Link 2023-11-16T05:38Z 36.6K followers, 13.5K engagements
"As good a time to say this as any: if youre on the AI research job market Databricks is hiring with the mission to democratize AI. We power amazing customer use cases and we publish. Check or reach out. https://www.databricks.com/company/careers https://www.databricks.com/company/careers"
X Link 2023-11-18T06:16Z 41.4K followers, 43.5K engagements
"Sad about the chaos around OpenAI which was crazier than anyone imagined and how its affecting people especially those on visas. I hope everyone lands on their feet"
X Link 2023-11-21T05:03Z 36.6K followers, 23.1K engagements
"We've just released a suite of awesome features for building high-quality RAG apps on Databricks: In talking with enterprises we found quality was often the top concern with RAG so we help teams monitor and improve it at all levels of the stack. https://www.databricks.com/blog/building-high-quality-rag-applications-databricks https://www.databricks.com/blog/building-high-quality-rag-applications-databricks"
X Link 2023-12-06T22:37Z 42.9K followers, 23.3K engagements
"The launches today: - Vector search for unstructured data - Online feature serving to make structured data available to RAG - Pay-by-token foundation model serving (LLaMa MPT and more) - Quality monitoring for production RAG apps - LLM and chain evaluation tools"
X Link 2023-12-06T22:37Z 36.9K followers, [----] engagements
"With these tools you can mix-and-match the best commercial or OSS models tune each component of the pipeline and monitor it all as data tables with all the functionality of the Databricks platform"
X Link 2023-12-06T22:37Z 37.3K followers, [----] engagements
"@AmbikaSukla Looks cool We'll have to try it on some datasets. It should be straightforward to run this and load the chunks into our vector store and pipelines"
X Link 2023-12-06T22:48Z 36.9K followers, [--] engagements
"There was a similar issue in a post from Microsoft earlier about "unlocking expertise" of GPT-4: the results stem from a good inference strategy with CoT and ensembling not just from GPT-4 which is only a statistical model"
X Link 2023-12-07T04:41Z 36.9K followers, [----] engagements
"As another example think 80% on GSM8k is impressive GPT-3.5 scored at 57% in OpenAI's own 5-shot eval but we got it to 80% with a small chaining + ensemble inference program in DSPy (Table [--] of We also got Llama-13B from 7% to 50%"
X Link 2023-12-07T04:41Z 36.8K followers, [----] engagements
"In short statistical model can't answer questions -- an inference system does. There's a lot of depth to figuring out the best inference systems/methods. CoT ToT few-shot etc explore this space and frameworks like our automatically optimize over it"
X Link 2023-12-07T04:41Z 36.9K followers, 13.4K engagements
"Within this context it is also super interesting to train models that are better at certain inference strategies like CoT. We're exploring this on the research team at Databricks/MosaicML"
X Link 2023-12-07T04:43Z 36.9K followers, [----] engagements
"Everyone is doing RAG on unstructured docs but what if you want to mix in structured business data Databricks RAG can connect to feature tables & functions to query the latest data in your catalog all with centralized governance security and MLOps. https://sprou.tt/1BoOJyvUN8J https://sprou.tt/1BoOJyvUN8J"
X Link 2023-12-09T23:17Z 41.6K followers, 25.1K engagements
"@AmbikaSukla I like your article -- catalogs and semantic layers definitely need to be expanded and cleaned up to fully integrate AI. For what it's worth we do have Lakehouse Federation in Databricks that lets you catalog and query data in other platforms:"
X Link 2023-12-09T23:50Z 36.9K followers, [---] engagements
"I'll be at #NeurIPS Tuesday-Friday this week ping me to connect We're recruiting researchers at @Databricks / @MosaicML with some really unique opportunities so drop by our social on Tuesday to chat with the team: https://events.databricks.com/Generative-AI-Social https://events.databricks.com/Generative-AI-Social"
X Link 2023-12-11T19:07Z 41.5K followers, 15.3K engagements
"Lakehouse Monitoring is now in public preview It's the industry's only unified quality service across data and AI with auto-generated metrics and dashboards and all info queryable as tables. It greatly simplifies life for both data and ML developers. https://sprou.tt/1HfTvaTHjzA https://sprou.tt/1HfTvaTHjzA"
X Link 2023-12-13T16:26Z 41.4K followers, [----] engagements
"Proud to see Databricks named a leader in the Gartner CDBMS MQ for the 3rd year advancing in both dimensions Weve made so many improvements to the platform this year and were just getting started with data intelligence marketplace cleanrooms & more. https://www.databricks.com/blog/databricks-named-leader-2023-gartner-magic-quadrant-cloud-database-management-systems https://www.databricks.com/blog/databricks-named-leader-2023-gartner-magic-quadrant-cloud-database-management-systems"
X Link 2023-12-22T06:03Z 41.9K followers, 31K engagements
"A lot happened in Databricks SQL in [----] -- no wonder it's one of the fastest growing data warehouse platforms. Read how we improved latency and concurrency made it serverless and began automatically optimizing most workloads with AI: https://www.databricks.com/blog/databricks-sql-year-review-part-i-ai-optimized-performance-and-serverless-compute https://www.databricks.com/blog/databricks-sql-year-review-part-i-ai-optimized-performance-and-serverless-compute"
X Link 2024-01-27T22:18Z 41.6K followers, 23.2K engagements
"@tim_kraska Congrats Tim and team"
X Link 2024-01-30T16:11Z 37.4K followers, [----] engagements
"Really proud that Databricks powered training @allen_ai'sOLMo 7B an open source state-of-the-art LLM that includes data code and checkpoints for all stages of training to promote open science. Awesome research contribution by AI2. https://sprou.tt/1f2199putg5 https://sprou.tt/1f2199putg5"
X Link 2024-02-01T20:15Z 41.5K followers, [----] engagements
"Interesting trend in AI: the best results are increasingly obtained by compound systems not monolithic models. AlphaCode ChatGPT+ Gemini are examples. In this post we discuss why this is and emerging research on designing & optimizing such systems. https://bair.berkeley.edu/blog/2024/02/18/compound-ai-systems/ https://bair.berkeley.edu/blog/2024/02/18/compound-ai-systems/"
X Link 2024-02-19T16:21Z 39.1K followers, 283.7K engagements
"Compound AI systems solve tasks through multiple calls to models and other components. Many recent state-of-the-art results and LLM programming techniques (chaining RAG) use compound systems"
X Link 2024-02-19T16:21Z 38.1K followers, [----] engagements
"Even LLM developers are now reporting results from inference strategies that call the model multiple times as Google did for Gemini on MMLU with CoT@32: This thread highlights a point we've been seeing in https://t.co/2ZsWoHElXJ for a while: you can't meaningfully talk about capabilities of a language model you have to talk about capabilities of a system including the inference algorithm. 32-CoT is not the same as 5-shot. This thread highlights a point we've been seeing in https://t.co/2ZsWoHElXJ for a while: you can't meaningfully talk about capabilities of a language model you have to"
X Link 2024-02-19T16:21Z 38.5K followers, [----] engagements
"And at @databricks we found that over 60% of enterprise customers' LLM applications used retrieval and 30% used complex multi-step chains"
X Link 2024-02-19T16:21Z 38.5K followers, [----] engagements
"Why are developers using compound systems and are they here to stay as models improve We think yes because they have [--] key advantages over models alone: [--]. More return-vs-cost in many cases [--]. Dynamicity [--]. Much better control safety & trust [--]. More cost-quality options"
X Link 2024-02-19T16:21Z 38.1K followers, [----] engagements
"But as people shift to compound AI systems an emerging question is how to design optimize & operate them. We can't use the same tools as for models e.g. they're not differentiable. We discuss some research on this like #DSPy and #FrugalGPT which can auto-optimize AI systems"
X Link 2024-02-19T16:21Z 38K followers, [----] engagements
"Really cool example of a compound AI system that enables new AI capabilities and its built using DSPy. I expect well see a lot more like it this year. I asked 🌪STORM to write an article on ColBERT. It produced a 3500-word article with [--] references 📸 Screenshots: * Part of the Table of Contents * Intro * Funny but important section on how "ColBERT late interaction" is different from "Colbert's Late Show" https://t.co/YXdgHABAm9 I asked 🌪STORM to write an article on ColBERT. It produced a 3500-word article with [--] references 📸 Screenshots: * Part of the Table of Contents * Intro * Funny"
X Link 2024-02-29T06:18Z 38.2K followers, 25.7K engagements
"Delta Sharing on @Cloudflare R2 is now in public preview on @Databricks allowing customers to distribute data globally with no egress fees Enables data delivery to any region and any compute platform thanks to the open Delta Sharing protocol. https://www.databricks.com/blog/announcing-public-preview-delta-sharing-cloudflare-r2-integration https://www.databricks.com/blog/announcing-public-preview-delta-sharing-cloudflare-r2-integration"
X Link 2024-02-29T19:21Z 40.6K followers, 16.4K engagements
"@lmeyerov I wanted a broader term that can capture things like self-driving cars as well which use multiple components but no LLMs. Then you can look at questions across these such as how to best optimize a multi-component system. Definitely makes sense to consider a general agent too"
X Link 2024-02-29T22:14Z 38.2K followers, [---] engagements
"We're running a great webinar on getting value from GenAI with @NaveenGRao @jefrankle and industry experts on March 14th. We'll also cover a bit of recent research from @Databricks Check it out: https://www.databricks.com/resources/webinar/gen-ai-payoff-2024utm_source=twitter&utm_medium=organic-social&utm_scid=701Vp000000ij02IAA https://www.databricks.com/resources/webinar/gen-ai-payoff-2024utm_source=twitter&utm_medium=organic-social&utm_scid=701Vp000000ij02IAA"
X Link 2024-03-12T20:54Z 39.4K followers, [----] engagements
"Databricks Feature Serving is now GA letting you read online data from your tables directly into ML and GenAI apps. Connect AI to your data https://www.databricks.com/blog/announcing-general-availability-databricks-feature-serving https://www.databricks.com/blog/announcing-general-availability-databricks-feature-serving"
X Link 2024-03-14T18:33Z 39.4K followers, [----] engagements
"Super excited to announce that @lilac_ai is joining Databricks Lilac has built amazing tech for exploring and cleaning text data at scale that well help bring to every AI user. https://www.databricks.com/blog/lilac-joins-databricks-simplify-unstructured-data-evaluation-generative-ai https://www.databricks.com/blog/lilac-joins-databricks-simplify-unstructured-data-evaluation-generative-ai"
X Link 2024-03-19T16:24Z 39.4K followers, [----] engagements
"Even the largest language models hallucinate. Thats why a lot of the action will likely be in compound AI systems to get highly accurate AI. Claude [--] Opus believes I am the co-founder and CEO of Anthropic where I "maintain a relatively low public profile": https://t.co/MxVBmcyuMr Claude [--] Opus believes I am the co-founder and CEO of Anthropic where I "maintain a relatively low public profile": https://t.co/MxVBmcyuMr"
X Link 2024-03-22T05:00Z 38.8K followers, 18.4K engagements
"Congrats to my student @ChenLingjiao for having two papers cited in the White House [----] Economic Report: HAPI and LLM shift in chapter [--] on economics of AI. Lingjiao was prescient to start studying ML-as-a-service and did other cool work like FrugalGPT. https://www.whitehouse.gov/cea/written-materials/2024/03/21/the-2024-economic-report-of-the-president/ https://www.whitehouse.gov/cea/written-materials/2024/03/21/the-2024-economic-report-of-the-president/"
X Link 2024-03-23T04:18Z 38.9K followers, 27.7K engagements
"DBRX is a 132B parameter MoE model with 36B active params and fine-grained (4-of-16) sparsity and 32K context. It was trained using the dropless MoE approach pioneered by my student @Tgale96 in MegaBlocks. Technical details: https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm"
X Link 2024-03-27T13:01Z 39.4K followers, [----] engagements
"You can try DBRX on Databricks model serving and playground today with an OpenAI-compatible API And if you want to tune RLHF or train your own model we have everything we needed to build this from scratch"
X Link 2024-03-27T13:01Z 39.4K followers, [----] engagements
"@natolambert @databricks Just our serving stack It will probably get even faster soon. Having just 36B live params makes a big difference"
X Link 2024-03-27T14:59Z 38.9K followers, [----] engagements
"Probably the thing Im most excited about with DBRX its super fast Easily [---] tokens/s for quality comparable to much slower closed models. Okay @databricks what're you cooking behind this space its so fast lmao https://t.co/DCWHOb6bUY Okay @databricks what're you cooking behind this space its so fast lmao https://t.co/DCWHOb6bUY"
X Link 2024-03-27T15:02Z 39K followers, 19.7K engagements
"@corbtt @databricks @jefrankle 👀"
X Link 2024-03-28T01:18Z 39K followers, [---] engagements
"Were hiring for the RAG / AG research team at Databricks. Come help make AI even better at incorporating real-time data and external tools. Hows your sabbatical WellDBRX is GREAT at RAG If youve been using Mixtral/Llama2/GPT3.5 then try DBRX The combination of RAG with its SoTA capabilities on knowledge/code/reasoning will unlock new CompoundAI opportunities. https://t.co/axbFHEHihl https://t.co/xnb4yujtaI Hows your sabbatical WellDBRX is GREAT at RAG If youve been using Mixtral/Llama2/GPT3.5 then try DBRX The combination of RAG with its SoTA capabilities on knowledge/code/reasoning will"
X Link 2024-03-28T01:37Z 39.4K followers, 40.6K engagements
"@MaziyarPanahi Its Databricks Model Serving"
X Link 2024-03-28T06:31Z 39K followers, [--] engagements
"@MaziyarPanahi @alighodsi @databricks Were working on simplifying the signup process for this. But right now once you create a Databricks account you can just directly call the open source models we host and pay by token even using an OpenAI client: https://docs.databricks.com/en/machine-learning/model-serving/score-foundation-models.html https://docs.databricks.com/en/machine-learning/model-serving/score-foundation-models.html"
X Link 2024-04-01T00:30Z 39.1K followers, [--] engagements
"Excited to speak about data intelligence and developments in open source data & AI in Tokyo tomorrow. Will cover #DBRX and the latest in @ApacheSpark (which we used to create the data for DBRX)"
X Link 2024-04-02T03:48Z 39.1K followers, [--] engagements
"Translated by #DBRX: 🔥Gen AI Meetup with Databricks CTO🔥 It's finally happening today🌸 Use the hashtag #matei_meetup to share your tweets☺ 🌟 Registration link Time April 3rd (Wednesday) 18:00- 📍 Location Otemachi Mitsui Hall"
X Link 2024-04-03T08:24Z 39K followers, [--] engagements
"AI can address the data warehouses biggest challenges thanks to its deeper understanding of your data and how its used. Join us in May to hear from @rxin how AI at Databricks helps users find and query the right data faster and auto-optimize performance. https://sprou.tt/146AfuXt02s https://sprou.tt/146AfuXt02s"
X Link 2024-04-08T01:21Z 40.2K followers, [----] engagements
"This is a cool paper but @ChenLingjiao and team's recent research showed that with majority voting performance can actually decrease past a certain number of agent calls. Check out There's lots left to figure out how to best build compound AI systems. "More Agents Is All You Need" - Nice Paper "When the ensemble size scales up to [--] Llama2-13B achieves comparable accuracy with Llama2-70B. Similarly When the ensemble size scales up to [--] and [--] Llama2-70B and GPT-3.5-Turbo achieve comparable accuracy with their more https://t.co/WeHda4SAHn"
X Link 2024-04-08T01:28Z 39.1K followers, 22.4K engagements
"We've added a lot of improvements for the deep learning training experience in @MLflow recently. Check out the latest from @_aiabe the product lead for this area at Databricks. https://www.loom.com/share/443a398dabd44eb2a30584036340f35e https://www.loom.com/share/443a398dabd44eb2a30584036340f35e"
X Link 2024-04-09T18:10Z 40.2K followers, [----] engagements
"Love how fast DBRX is that was one of our goals There are many strong open source models coming out which is awesome -- excited to see what people do with these. Latest AI showdown 🤜🏼🤛🏼 [--]. @MistralAI 8x22B vs @databricks DBRX Instruct [--]. @GoogleAI Gemini [---] Pro vs new @OpenAI GPT-4-Turbo vision. Details 👇 https://t.co/gsq7nXPhMG Latest AI showdown 🤜🏼🤛🏼 [--]. @MistralAI 8x22B vs @databricks DBRX Instruct [--]. @GoogleAI Gemini [---] Pro vs new @OpenAI GPT-4-Turbo vision. Details 👇 https://t.co/gsq7nXPhMG"
X Link 2024-04-12T17:41Z 39.2K followers, 11.3K engagements
"Another major data provider on Databricks Marketplace welcome @ICE_Markets Premier datasets in finance are now available on the #DatabricksMarketplace thanks to @ICE_Markets. These datasets enable key use cases like time-series analysis relative value spread analysis and assessing climate risk exposure. https://t.co/rmei6qZ93G https://t.co/smLStSlB8f Premier datasets in finance are now available on the #DatabricksMarketplace thanks to @ICE_Markets. These datasets enable key use cases like time-series analysis relative value spread analysis and assessing climate risk exposure."
X Link 2024-04-18T00:34Z 40.5K followers, [----] engagements
"Awesome release congrats @AIatMeta and excited that Databricks is a launch partner Introducing Meta Llama 3: the most capable openly available LLM to date. Today were releasing 8B & 70B models that deliver on new capabilities such as improved reasoning and set a new state-of-the-art for models of their sizes. Today's release includes the first two Llama [--] https://t.co/Q80lVTeS7m Introducing Meta Llama 3: the most capable openly available LLM to date. Today were releasing 8B & 70B models that deliver on new capabilities such as improved reasoning and set a new state-of-the-art for models of"
X Link 2024-04-18T16:35Z 40.5K followers, 13.5K engagements
"I'm co-organizing the inaugural research workshop on Compound AI Systems on June 13th: . Send in your work on designing & optimizing such systems Thrilled to have @RichardSocher @MonicaSLam and @polynoamial as speakers and host this at @Data_AI_Summit. https://sites.google.com/view/compound-ai-systems-workshop/home https://sites.google.com/view/compound-ai-systems-workshop/home"
X Link 2024-04-22T22:47Z 39.5K followers, 38K engagements
"Databricks Asset Bundles (DABs) is now GA. It lets you deploy data and AI projects as config-based packages and integrates great with Git CI/CD and IDEs -- greatly streamlines data and AI deployment using modern software engineering practices. https://sprou.tt/1ubhaEia3Eu https://sprou.tt/1ubhaEia3Eu"
X Link 2024-04-23T23:03Z 40.5K followers, [----] engagements
"Super cool that this state-of-the-art medical NLP result was achieved using @lateinteraction's #DSPy. Beginning of the age of auto-optimized compound AI systems IReRa is another example of an auto-optimized SOTA pipeline https://arxiv.org/abs/2401.12178 (1/3) 🎉 Exciting News: Our WangLab team has won first place in the [----] MEDIQA Clinical NLP competitions for the second consecutive year 🥇🥇 This year MEDIQA [----] has two tracks: 1) Medical Error Detection & Correction; 2) Multilingual & Multimodal Medical Answer https://t.co/1HhuMNKc9I https://arxiv.org/abs/2401.12178 (1/3) 🎉 Exciting"
X Link 2024-04-27T01:21Z 39.5K followers, 29.4K engagements
"When you share a dataset with Delta Sharing @tableau users can now directly connect to it That's the benefit of an open protocol for data sharing which Delta Sharing uniquely provides. Don't build your collaboration architecture on something closed. Excited to introduce the new @tableau #DeltaSharing connector and 'Explore in Tableau' capability Together these updates will help customers simplify data sharing + collaboration and uncover insights faster. #Data24 https://t.co/ZF26b9nAky Excited to introduce the new @tableau #DeltaSharing connector and 'Explore in Tableau' capability Together"
X Link 2024-05-03T16:21Z 40.4K followers, [----] engagements
"Want to talk AI research and best practices with the people working on it The @DbrxMosaicAI research team is running meetups worldwide in May. https://www.linkedin.com/pulse/databricks-mosaic-ai-meetups-coming-city-near-you-mosaicresearch-q93qc/trackingId=kwTVyPfOQVSockQo7lR5kw%3D%3D https://www.linkedin.com/pulse/databricks-mosaic-ai-meetups-coming-city-near-you-mosaicresearch-q93qc/trackingId=kwTVyPfOQVSockQo7lR5kw%3D%3D"
X Link 2024-05-03T16:34Z 40.5K followers, 25.2K engagements
"Super excited that @drfeifei will be speaking at Data + AI Summit Check it out on June 10-13. Explore the next frontier of AI with @drfeifei Professor @Stanford Co-Director @StanfordHAI & leader of human-centered AI she'll be sharing tons of insights at #DataAISummit. Don't miss it register now https://t.co/aBfW0Qf0lk https://t.co/FAa6Pztrmu Explore the next frontier of AI with @drfeifei Professor @Stanford Co-Director @StanfordHAI & leader of human-centered AI she'll be sharing tons of insights at #DataAISummit. Don't miss it register now https://t.co/aBfW0Qf0lk https://t.co/FAa6Pztrmu"
X Link 2024-05-08T16:54Z 40.5K followers, 15.2K engagements
"Very excited to hear @YejinChoinka speak at this year's #DataAISummit. Join us on June 10-13. Don't miss the #DataAISummit keynote from Yejin Choi Professor + Sr. Research Director for Commonsense AI at AI2 We recently worked with AI2 to train their OLMo 7B a SOTA LLM on Databricks #MosaicAI. Don't miss great GenAI insights Register now https://t.co/aBfW0Qf0lk https://t.co/bRTrktmI0R Don't miss the #DataAISummit keynote from Yejin Choi Professor + Sr. Research Director for Commonsense AI at AI2 We recently worked with AI2 to train their OLMo 7B a SOTA LLM on Databricks #MosaicAI. Don't miss"
X Link 2024-05-09T18:47Z 43.5K followers, [----] engagements
"Really thrilled to announce @lmthang as a speaker at the Compound AI Systems workshop Thang is a Researcher at DeepMind and will discuss his teams recent work on #AlphaGeometry. Submit your talks to the workshop by May https://sites.google.com/view/compound-ai-systems-workshop/home https://sites.google.com/view/compound-ai-systems-workshop/home"
X Link 2024-05-10T21:54Z 40.5K followers, [----] engagements
"Other speakers include: @polynoamialResearch Scientist at OpenAI and pioneer in multi-step reasoning self-play and multi-agent AI. @MonicaSLamProfessor of CS at Stanford and director of OVAL lab. @RichardSocherFounder and CEO and NLP pioneer. http://You.com http://You.com"
X Link 2024-05-10T21:54Z 40.5K followers, [----] engagements
"We just launched Databricks Assistant Autocomplete another context-aware AI feature using our data intelligence engine. Now your autocomplete in notebooks and SQL is aware of all the data in your catalog and how it is used https://sprou.tt/1bL8Hneo5iZ https://sprou.tt/1bL8Hneo5iZ"
X Link 2024-05-21T17:58Z 40.8K followers, 16.1K engagements
"@robsonluizsoul Yup we are adding collations support in Spark SQL and all parts of Databricks. Thanks for the feedback https://issues.apache.org/jira/browse/SPARK-46837 https://issues.apache.org/jira/browse/SPARK-46837"
X Link 2024-05-21T21:21Z 40.7K followers, [---] engagements
"Vector Search on Databricks is now GA You can just turn on vector search serving on an existing table to serve it without setting up other infra and we've optimized it for high retrieval quality and low latency. https://www.databricks.com/blog/announcing-mosaic-ai-vector-search-general-availability-databricks https://www.databricks.com/blog/announcing-mosaic-ai-vector-search-general-availability-databricks"
X Link 2024-05-22T23:54Z 40.8K followers, [----] engagements
"@PrescientTrade This probably wont help with traditional data warehousing use cases other than enabling similarly search but you can also use Databricks to build the data pipeline for an AI app and serve that data (for example crawled documents)"
X Link 2024-05-23T03:10Z 40.7K followers, [---] engagements
"Liquid Clustering is now GA on Databricks -- a new layout strategy that outperforms partitioning and does not require tuning. This went from an idea in our engineering team to supporting 1000+ customers and 100+ petabytes of tables in just one year https://www.databricks.com/blog/announcing-general-availability-liquid-clustering https://www.databricks.com/blog/announcing-general-availability-liquid-clustering"
X Link 2024-05-23T22:35Z 40.9K followers, [----] engagements
"Public registration for the Compound AI Systems workshop next week filled up in about [--] minutes but we've saved some spots for researchers. Sign up at to join the waitlist. See you at @Data_AI_Summit. https://docs.google.com/forms/d/1vjXr6paiju-To-NJQ360MRnnhyCY7k48Cwg2gOqaldI/edit https://docs.google.com/forms/d/1vjXr6paiju-To-NJQ360MRnnhyCY7k48Cwg2gOqaldI/edit"
X Link 2024-06-03T21:11Z 41.1K followers, 13.2K engagements
"The next generation of Databricks Notebooks is rolling out now with some awesome UX and performance improvements and context-aware AI. Here's what's new: https://www.databricks.com/blog/next-generation-databricks-notebooks-simple-and-powerful https://www.databricks.com/blog/next-generation-databricks-notebooks-simple-and-powerful"
X Link 2024-06-05T16:42Z 41.1K followers, [----] engagements
"Thrilled that Forrester named Databricks a Leader in their report on AI Foundation Models in enterprise We help organizations build the best AI for their domain and data using the best techniques available with a world-class research team to back it. https://www.databricks.com/blog/databricks-named-leader-forrester-wavetm-ai-foundation-models-language-q2-2024 https://www.databricks.com/blog/databricks-named-leader-forrester-wavetm-ai-foundation-models-language-q2-2024"
X Link 2024-06-05T16:53Z 41.3K followers, 29.8K engagements
"Check out @Data_AI_Summit next week for some exciting announcements on new infrastructure and research results that are helping customers achieve this"
X Link 2024-06-05T16:53Z 40.9K followers, [----] engagements
"We're excited to welcome [--] new strategic data collaboration partners into the Delta Sharing and Databricks Marketplace ecosystem bringing the best data and AI assets in the industry to users. Also cool that sharing on Databricks is growing 300% YoY https://www.databricks.com/company/newsroom/press-releases/databricks-doubles-down-delta-sharing-open-ecosystem-strategic-partnerships https://www.databricks.com/company/newsroom/press-releases/databricks-doubles-down-delta-sharing-open-ecosystem-strategic-partnerships"
X Link 2024-06-06T21:14Z 41.3K followers, [----] engagements
"@code_star This one does not spark AGI"
X Link 2024-06-08T01:44Z 40.9K followers, [----] engagements
"This Monday in SF our MosaicX meetup is essentially a mini-conference on AI Hear from @jefrankle @realSharonZhou @jerryjliu0 @sarahcat21 @JuliaANeagu @yaronsinger @jazco and many others on the latest research. We're kicking off the Data+AI Summit with the #MosaicX #Meetup: San Francisco Edition on Monday June 10th. We're at the #Moscone Center South 2nd floor with over [----] registrants and [--] speakers across four tracks. It's a "slightly" packed agenda with: ✅ Discussion panels https://t.co/REtSfMkR4h We're kicking off the Data+AI Summit with the #MosaicX #Meetup: San Francisco Edition on"
X Link 2024-06-08T19:46Z 41.1K followers, 31.5K engagements
"@NaveenGRao @Data_AI_Summit @databricks There arent many good excuses to miss @Data_AI_Summit but I guess this one is OK"
X Link 2024-06-10T16:18Z 41.1K followers, [----] engagements
"Super excited about the new Agent Framework Tool Catalog Vector Search Evaluation and Training capabilities we launched today in Mosaic AI. We see more companies building compound AI systems and we have created an end-to-end environment to do this. https://www.databricks.com/blog/mosaic-ai-build-and-deploy-production-quality-compound-ai-systems https://www.databricks.com/blog/mosaic-ai-build-and-deploy-production-quality-compound-ai-systems"
X Link 2024-06-12T17:10Z 41.3K followers, 29.2K engagements
"This is a great example of companies turning their data into new AI products: @Shutterstock partnered with @Databricks to create this state of the art text-to-image model. Awesome partnership with the @DbrxMosaicAI research team to make this fast and high-quality. today we're announcing our @DbrxMosaicAI x @Shutterstock partnership and a new text-to-image diffusion model: ✨ImageAI✨ this model is geared towards enterprise use cases and is trained exclusively on shutterstock's trusted data catalog https://t.co/H7FtlZs0ne https://t.co/DNKxz7zoTn today we're announcing our @DbrxMosaicAI x"
X Link 2024-06-12T17:32Z 41.1K followers, [----] engagements
"We just posted the first release of open source Unity Catalog It supports tables unstructured data and AI and we have a great set of partners across data and AI integrating with it. Read more at https://www.databricks.com/blog/open-sourcing-unity-catalog .@matei_zaharia just open sourced Unity Catalog LIVE at #DataAISummit https://t.co/jrLbvN0r1R https://www.databricks.com/blog/open-sourcing-unity-catalog .@matei_zaharia just open sourced Unity Catalog LIVE at #DataAISummit https://t.co/jrLbvN0r1R"
X Link 2024-06-13T18:12Z 42.5K followers, 28.8K engagements
"The Compound AI Workshop at DAIS is kicking off with @lmthang. Super excited about our program Thanks to the great speakers and organizers https://sites.google.com/view/compound-ai-systems-workshop/home https://sites.google.com/view/compound-ai-systems-workshop/home"
X Link 2024-06-13T20:26Z 41.2K followers, 18.1K engagements
"@Ken_Goldberg @databricks Fantastic talk Ken Thanks for joining"
X Link 2024-06-14T03:54Z 41.1K followers, [---] engagements
"@WangUWS @databricks @Data_AI_Summit Closest you can get to DJing at a tech conference I guess"
X Link 2024-06-14T03:57Z 41.2K followers, [---] engagements
"Compound AI systems for the win Makes sense that a program search approach could do well on this. I asked Buck about his thoughts on ARC-AGI to prepare for interviewing @fchollet. He tells his coworker Ryan and within [--] days they've beat SOTA on ARC and are on the heels of average human performance. 🤯 "On a held-out subset of the train set where humans get 85% accuracy https://t.co/MmlLe2Miuh I asked Buck about his thoughts on ARC-AGI to prepare for interviewing @fchollet. He tells his coworker Ryan and within [--] days they've beat SOTA on ARC and are on the heels of average human performance."
X Link 2024-06-17T19:05Z 41.1K followers, 12K engagements
"Really proud of our team for being named a leader in the Gartner MQ on Data Science and Machine Learning again and ranked highest in Ability to Execute By integrating ML deeply with data platform tools we're simplifying it in ways that other AI/ML platforms can't. Databricks named a Leader in the [----] Gartner Magic Quadrant for Data Science and ML Platforms & positioned highest in Ability to Execute out of all evaluated vendors We believe this recognition validates our focus on GenAI & traditional data science https://t.co/G7XqypmYnB https://t.co/f4UFC59Gdv Databricks named a Leader in the"
X Link 2024-06-20T17:15Z 41.2K followers, [----] engagements
"There are a lot of great new partners and features for Delta Sharing this year and its been growing 300% YoY to become one of the largest secure data sharing protocols in the industry (and the main cross platform one). Heres whats new: We recently announced new Delta Sharing innovations that enable Data + AI success This includes: - GA of volume sharing and Cloudflare R2 support - Cross-platform view sharing - Sharing for Lakehouse Federation and more👇 https://t.co/Wt1fHC52OS https://t.co/UiY7rbHUv6 We recently announced new Delta Sharing innovations that enable Data + AI success This"
X Link 2024-06-25T20:52Z 41.3K followers, [----] engagements
"Databricks Assistant our in-context AI is now GA I'm really proud of what the team built: it's one of the most effective AI assistants in the industry according to users thanks to integrating context like related code data usage patterns etc. https://sprou.tt/1j98qM3klMN https://sprou.tt/1j98qM3klMN"
X Link 2024-06-27T23:53Z 41.3K followers, 21K engagements
"Great to see @databricks' approach to data engineering and streaming recognized in two reports: - [----] IDC MarketScape: Worldwide Analytic Stream Processing - The Forrester Wave: Cloud Data Pipelines Q4'23 We're making these even better with Lakeflow. https://sprou.tt/1gUCxSfvh8m https://sprou.tt/1gUCxSfvh8m"
X Link 2024-07-10T00:00Z 41.5K followers, [----] engagements
"Great post by @celebaltech on implementing RAFT on top of @databricks fine-tuning to out-perform RAG: Incidentally the RAFT paper will be presented at @COLM_conf so check it out if you're there. https://celebaltech.com/blogs/enhancing-rag-systems-with-fine-tuned-language-models-on-databricks https://celebaltech.com/blogs/enhancing-rag-systems-with-fine-tuned-language-models-on-databricks"
X Link 2024-07-11T17:41Z 41.5K followers, 13.8K engagements
"@berenguel @celebaltech @databricks @COLM_conf Oh no that's confusing"
X Link 2024-07-11T18:08Z 41.5K followers, [---] engagements
"Congrats @AIatMeta on the Llama [---] release and super thrilled to be a launch partner Llama [---] is a huge step forward for open models at all scales. Thrilled to offer the @AIatMeta Llama [---] series of models on Databricks These models expand context length to 128K add multilingual capabilities + include Llama [---] 405B the largest + highest-quality openly available foundation model. https://t.co/C0Fcopr7dx Thrilled to offer the @AIatMeta Llama [---] series of models on Databricks These models expand context length to 128K add multilingual capabilities + include Llama [---] 405B the largest +"
X Link 2024-07-23T15:44Z 41.6K followers, [----] engagements
"@gkhandya @AIatMeta Yup"
X Link 2024-07-23T15:56Z 41.6K followers, [--] engagements
"How can you make LLM-as-judge reliable in specialized domains Our applied AI team developed a simple but effective approach called Grading Notes that we've been using in Databricks Assistant. We think this can help anyone doing domain-specific AI https://www.databricks.com/blog/enhancing-llm-as-a-judge-with-grading-notes https://www.databricks.com/blog/enhancing-llm-as-a-judge-with-grading-notes"
X Link 2024-07-24T18:16Z 41.6K followers, 16.8K engagements
"We're hosting the Berkeley LLM Meetup next week at Databricks with talks by #DSPy's @michaelryan207 on prompt optimization and SWE-Agent's creator @_carlosejimenez on automating software engineering with LLMs. Sign up here: https://lu.ma/berkeley-llm-meetup-july https://lu.ma/berkeley-llm-meetup-july"
X Link 2024-07-26T20:56Z 41.7K followers, 13.5K engagements
"Data sharing features are often locked into one platform. We started #DeltaSharing as the first open protocol for data sharing and its taking off: 40% of our customers shares go outside Databricks Read how @Atlassian @Nasdaq @Oracle and others use it: https://www.databricks.com/blog/democratizing-data-sharing-platform-agnostic-approach https://www.databricks.com/blog/democratizing-data-sharing-platform-agnostic-approach"
X Link 2024-08-01T15:13Z 41.7K followers, [----] engagements
"Databricks Clean Rooms are now in public preview letting you do private joint computation with any API in Databricks (SQL Python R Apache Spark ML GenAI and more) combining data from multiple organizations on different clouds and platforms. https://www.databricks.com/blog/databricks-clean-rooms-privacy-safe-collaboration-public-preview https://www.databricks.com/blog/databricks-clean-rooms-privacy-safe-collaboration-public-preview"
X Link 2024-08-07T21:58Z 42.8K followers, [----] engagements
"Does long context solve RAG We found that many long-context models fail in specific and weird ways as you grow context length making the optimal system design non-obvious. Some models tend to say there's a copyright issue some tend to summarize etc. https://www.databricks.com/blog/long-context-rag-performance-llms https://www.databricks.com/blog/long-context-rag-performance-llms"
X Link 2024-08-13T15:36Z 42.2K followers, 40.2K engagements
"Not a problem with Lakehouse. my friend works in fashion. i set her up with one of my tech homies. this is how it went. https://t.co/7kU3DN86ai my friend works in fashion. i set her up with one of my tech homies. this is how it went. https://t.co/7kU3DN86ai"
X Link 2024-08-14T01:02Z 42.2K followers, 53.9K engagements
"Welcome Omar and really excited to keep working together on research along with the DSPy community. Some personal news: I'm thrilled to have joined @Databricks @DbrxMosaicAI as a Research Scientist last month before I start as MIT faculty in July [----] Expect increased investment into the open-source DSPy community new research & strong emphasis on production concerns 🧵. Some personal news: I'm thrilled to have joined @Databricks @DbrxMosaicAI as a Research Scientist last month before I start as MIT faculty in July [----] Expect increased investment into the open-source DSPy community new"
X Link 2024-08-19T23:02Z 42.3K followers, 18.7K engagements
"@nandan__thakur @databricks @DbrxMosaicAI @mrdrozdov @lateinteraction @sam_havens @mcarbin Welcome Nandan"
X Link 2024-08-19T23:34Z 42.2K followers, [---] engagements
"@DipendraMisra @databricks @DbrxMosaicAI Welcome Dipendra"
X Link 2024-08-24T04:13Z 42.3K followers, [---] engagements
"Building AI judges for real-world apps is hard -- unlike academic benchmarks many of these have long answers in complex domains. Here's how we improved Databricks Agent Eval for these use cases to perform 10% better on customer datasets: https://www.databricks.com/blog/databricks-announces-significant-improvements-built-llm-judges-agent-evaluation https://www.databricks.com/blog/databricks-announces-significant-improvements-built-llm-judges-agent-evaluation"
X Link 2024-09-06T16:31Z 42.3K followers, [----] engagements
"@thomasahle @TAG_News Not really but we have a GitHub org here: https://github.com/tag-research https://github.com/tag-research"
X Link 2024-09-06T21:34Z 42.3K followers, [---] engagements
"AI Gateways are a critical pattern to use LLMs in production allowing you to easily switch between models log events and implement security rate limiting and cost control. We've just updated Databricks AI Gateway with a slew of new features that work across providers and OSS. Thrilled to introduce new updates to #MosaicAI Gateway Simplified secure & governed AI for all your GenAI models. This release adds advanced features in usage tracking payload logging & guardrails to help customers accelerate their AI initiatives. https://t.co/HpOUkNOFHx Thrilled to introduce new updates to #MosaicAI"
X Link 2024-09-10T18:27Z 42.3K followers, [----] engagements
"Really cool to see OpenAI o1 launched today. It's another example of the trend towards compound AI systems not models getting the best AI results. I'm sure that future versions will not only scale inference but also use tools (coding search etc) for better results. Interesting trend in AI: the best results are increasingly obtained by compound systems not monolithic models. AlphaCode ChatGPT+ Gemini are examples. In this post we discuss why this is and emerging research on designing & optimizing such systems. https://t.co/tfnNuoTNNY Interesting trend in AI: the best results are increasingly"
X Link 2024-09-12T22:01Z 42.2K followers, 18.9K engagements
"There are lots of ways to combine models and tools to get better results so it will be interesting to see which ones do best for which tasks. We talked about some of them here: https://bair.berkeley.edu/blog/2024/02/18/compound-ai-systems/ https://bair.berkeley.edu/blog/2024/02/18/compound-ai-systems/"
X Link 2024-09-12T22:01Z 42.3K followers, [----] engagements
"Super excited about the new 1B and 3B Llama models and multimodal Llama The cost-performance of open source AI is improving dramatically and private device-local AI is becoming practical with these models. Proud that @databricks is a launch partner. 📣 Introducing Llama 3.2: Lightweight models for edge devices vision models and more Whats new Llama [---] 1B & 3B models deliver state-of-the-art capabilities for their class for several on-device use cases with support for @Arm @MediaTek & @Qualcomm on day one. https://t.co/lx4N2qGSCe 📣 Introducing Llama 3.2: Lightweight models for edge devices"
X Link 2024-09-25T19:37Z 42.3K followers, [----] engagements
"Super excited by what the team has built with Apps supporting all the major Python frameworks for deploying internal data or AI apps directly from your workspace. Check it out today Introducing Databricks Apps a new way to build internal data + AI applications. Build data visualizations AI applications and self-service analytics directly on the Databricks Data Intelligence Platform. Now in Public Preview on AWS and Azure. https://t.co/QYCPLzbm2t https://t.co/TdY7C45htm Introducing Databricks Apps a new way to build internal data + AI applications. Build data visualizations AI applications and"
X Link 2024-10-08T20:15Z 42.2K followers, [----] engagements
"Our new batch inference offering from @databricks launched today making it easy to get reliable low-cost inference right from SQL. No need to export data to another system or format just call ai_query and we'll automatically scale and mange resources. https://www.databricks.com/blog/introducing-simple-fast-and-scalable-batch-llm-inference-mosaic-ai-model-serving https://www.databricks.com/blog/introducing-simple-fast-and-scalable-batch-llm-inference-mosaic-ai-model-serving"
X Link 2024-10-22T21:33Z 44.8K followers, [----] engagements
"We've expanded our collaboration with Dun & Bradstreet to bring their industry-leading commercial data on hundreds of millions of businesses to the Databricks Marketplace Every Databricks customer can now easily connect to this data. https://sprou.tt/1SN4eUIRS2h https://sprou.tt/1SN4eUIRS2h"
X Link 2024-10-30T20:24Z 43.5K followers, [----] engagements
"You can now use MLflow to log and trace OpenAI Swarm applications. This adds to our support for GenAI tracing and MLOps in LangChain LangGraph LlamaIndex AutoGen and other frameworks giving you a consistent MLOps stack across them. MLflow's OpenAI autologging now includes built-in tracing for OpenAI Swarm multi-agent systems with one line of code: mlflow.openai.autolog() That's all it takes to get full visibility into every agent handoff and tool call. #MLflow #AI #OpenAI https://t.co/fkXFm0rvM1 MLflow's OpenAI autologging now includes built-in tracing for OpenAI Swarm multi-agent systems"
X Link 2024-11-01T17:59Z 42.3K followers, [----] engagements
"Some surprising results on current neural rerankers by @mat_jacob1002 and the Databricks research team It's time to revisit common assumptions in IR Embeddings have improved drastically but mainstream IR evals have stagnated since MSMARCO and BEIR. We ask: on private or tricky IR tasks are current rerankers even better Surely reranking as many docs as you can afford is best https://t.co/sLwCHMH2x6 It's time to revisit common assumptions in IR Embeddings have improved drastically but mainstream IR evals have stagnated since MSMARCO and BEIR. We ask: on private or tricky IR tasks are current"
X Link 2024-11-20T18:11Z 42.4K followers, 10.5K engagements
"@Ahmad_Al_Dahle Congrats on the launch"
X Link 2024-12-06T21:11Z 42.3K followers, [---] engagements
"Congrats to the Meta team on Llama [---]. Open weight models are advancing so rapidly and the cost to get this performance is quickly going down. We're thrilled to let users serve and customize this on @databricks starting next week. Introducing Llama [---] a new 70B model that delivers the performance of our 405B model but is easier & more cost-efficient to run. By leveraging the latest advancements in post-training techniques including online preference optimization this model improves core performance at https://t.co/6oQ7b3Yuzc Introducing Llama [---] a new 70B model that delivers the"
X Link 2024-12-06T21:13Z 42.4K followers, [----] engagements
"This is a big launch for our AI agent platform -- making it easier to create high quality evaluations which is often the bottleneck for improving agents. Our researchers and engineers collaborated to automatically generate high-quality questions and provide a great curation UI. Introducing new synthetic data capabilities in Mosaic AI Agent Evaluation. Now developers can create high-quality evaluation data sets based on their proprietary data in just minutes without being bottlenecked by SMEs. How to get started👇https://t.co/rbFVoGfJaS Introducing new synthetic data capabilities in Mosaic AI"
X Link 2024-12-09T21:00Z 42.4K followers, [----] engagements
"Congrats to these awesome startups @vevo_ai @OrbyAI @ChipStackAI Announcing the winners of the Databricks #GenerativeAI Startup Challenge - Grand Prize: @vevo_ai - Second Place: @OrbyAI - Third Place: @ChipStackAI - Honorable Mention: Flagler Health Were thrilled to see their continued growth and impact https://t.co/qD4jtDhwCH https://t.co/zQdmodRPXX Announcing the winners of the Databricks #GenerativeAI Startup Challenge - Grand Prize: @vevo_ai - Second Place: @OrbyAI - Third Place: @ChipStackAI - Honorable Mention: Flagler Health Were thrilled to see their continued growth and impact"
X Link 2024-12-11T18:25Z 42.4K followers, [----] engagements
Limited data mode. Full metrics available with subscription: lunarcrush.com/pricing