Create accountLogin

Recent searches

No recent searches

Search options

Only available when logged in.
c.im is one of the many independent Mastodon servers you can use to participate in the fediverse.
C.IM is a general, mainly English-speaking Mastodon instance.

Administered by:

Server stats:

2.8K
active users

c.im: AboutStatusProfiles directoryPrivacy policy

Mastodon: AboutGet the appKeyboard shortcutsView source codev4.3.6

#databricks

0 posts0 participants0 posts today
Pedro Faria<p>New post about how to write data from a Apache Spark DataFrame into a Elasticsearch/Opensearch database <a href="https://fosstodon.org/tags/datascience" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>datascience</span></a> <a href="https://fosstodon.org/tags/databricks" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>databricks</span></a> <a href="https://fosstodon.org/tags/elasticsearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>elasticsearch</span></a> <a href="https://fosstodon.org/tags/opensearch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>opensearch</span></a> <a href="https://fosstodon.org/tags/bigdata" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>bigdata</span></a> <a href="https://fosstodon.org/tags/apachespark" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>apachespark</span></a> <a href="https://fosstodon.org/tags/spark" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>spark</span></a> <a href="https://fosstodon.org/tags/tech" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>tech</span></a> <a href="https://fosstodon.org/tags/programming" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>programming</span></a> <a href="https://fosstodon.org/tags/python" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>python</span></a>:</p><p><a href="https://pedro-faria.netlify.app/posts/2025/2025-03-16-spark-elasticsearch/en/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">pedro-faria.netlify.app/posts/</span><span class="invisible">2025/2025-03-16-spark-elasticsearch/en/</span></a></p>
Python Job Support<p>What is Apache Spark? Learn Apache Spark in 15&nbsp;Minutes</p><p>apachespark <a href="https://mastodon.social/tags/databricks" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>databricks</span></a> <a href="https://mastodon.social/tags/sparkteam" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>sparkteam</span></a> <a href="https://mastodon.social/tags/dataengineering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>dataengineering</span></a> <a href="https://mastodon.social/tags/pyspark" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>pyspark</span></a> <a href="https://mastodon.social/tags/architecture" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>architecture</span></a> In this video, I have covered the most important ... source</p><p><a href="https://quadexcel.com/wp/what-is-apache-spark-learn-apache-spark-in-15-minutes/" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="ellipsis">quadexcel.com/wp/what-is-apach</span><span class="invisible">e-spark-learn-apache-spark-in-15-minutes/</span></a></p>
Roy #EatTheRich Pardee 🇺🇸<p>My Q in a work meeting just now: "So we're moving away from <a href="https://hachyderm.io/tags/Teradata" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Teradata</span></a> b/c the pricing has become untenable. Are you all thinking about how/where we move again if the same thing becomes true of <a href="https://hachyderm.io/tags/databricks" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>databricks</span></a> ?"</p><p>Leadership did *not* like that question...</p>
Chris Gervais 🎸🥁💻<p>Work and life have been so extremely busy that I’ve had almost no time to work on my <a href="https://hachyderm.io/tags/marchintosh" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>marchintosh</span></a> project. What I have in mind probably couldn’t have hit releasable form this month, but I’m still going to hack away on it.</p><p>I have a long flight to Vegas Monday night for a conference so hoping to get some coding in on the plane ride there and back.</p><p>If you’re attending <a href="https://hachyderm.io/tags/HIMSS" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>HIMSS</span></a> this year, I’ll be around and speaking in the <a href="https://hachyderm.io/tags/databricks" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>databricks</span></a> theater on Tuesday afternoon if you want to meet up!</p>
CoffeeBean<p>Wo setzt ihr Machine Learning ein, um Prozesse zu verbessern? Habt ihr Beispiele aus eurem beruflichen Alltag?</p><p><a href="https://troet.cafe/tags/machinelearning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>machinelearning</span></a> <a href="https://troet.cafe/tags/databricks" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>databricks</span></a> <a href="https://troet.cafe/tags/ai" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ai</span></a> <a href="https://troet.cafe/tags/maschinelleslernen" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>maschinelleslernen</span></a> <a href="https://troet.cafe/tags/prozessverbesserungen" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>prozessverbesserungen</span></a></p>
Overture Rede Private Limited<p>Position: Databricks + Unity Catalog Engineer<br>📍 Location: Bangalore, Pune, Mumbai, Noida, Gurugram<br>⏳ Notice Period: Immediate to February Serving<br>🔹 Experience: 6+ Years</p><p>✅ Experience in Data Engineering &amp; Governance</p><p>📩 Submit your CV: resumes@overturerede.zohorecruitmail.in</p><p>📞 Contact: +917428694900</p><p>📢 Apply now and be part of cutting-edge data solutions!<br><a href="https://zurl.co/IeK73" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="">zurl.co/IeK73</span><span class="invisible"></span></a></p><p><a href="https://mastodon.social/tags/Hiring" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Hiring</span></a> <a href="https://mastodon.social/tags/Databricks" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Databricks</span></a> <a href="https://mastodon.social/tags/UnityCatalog" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>UnityCatalog</span></a> <a href="https://mastodon.social/tags/DataEngineering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>DataEngineering</span></a> <a href="https://mastodon.social/tags/SQL" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>SQL</span></a> <a href="https://mastodon.social/tags/Python" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Python</span></a> <a href="https://mastodon.social/tags/BigData" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>BigData</span></a> <a href="https://mastodon.social/tags/TechCareers" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>TechCareers</span></a></p>
Markus Suhr<p>Just caught up with the recent Delta Lake webinar, </p><p>&gt; Revolutionizing Delta Lake workflows on AWS Lambda with Polars, DuckDB, Daft &amp; Rust</p><p>Some interesting hints there regarding lightweight processing of big-ish data. Easy to relate to any other framework instead of Lambda, e.g. <a href="https://gruene.social/tags/ApacheAirflow" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>ApacheAirflow</span></a> tasks</p><p><a href="https://youtu.be/BR9oFD0QMAs" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://</span><span class="">youtu.be/BR9oFD0QMAs</span><span class="invisible"></span></a></p><p><a href="https://gruene.social/tags/dataengineering" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>dataengineering</span></a> <a href="https://gruene.social/tags/datascience" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>datascience</span></a> <a href="https://gruene.social/tags/duckdb" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>duckdb</span></a> <a href="https://gruene.social/tags/daft" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>daft</span></a> <a href="https://gruene.social/tags/polars" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>polars</span></a> <a href="https://gruene.social/tags/pandas" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>pandas</span></a> <a href="https://gruene.social/tags/python" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>python</span></a> <a href="https://gruene.social/tags/spark" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>spark</span></a> <a href="https://gruene.social/tags/deltalake" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>deltalake</span></a> <a href="https://gruene.social/tags/databricks" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>databricks</span></a> <a href="https://gruene.social/tags/airflow" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>airflow</span></a> <a href="https://gruene.social/tags/bigdata" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>bigdata</span></a> <a href="https://gruene.social/tags/smalldata" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>smalldata</span></a></p>
Angela Henry<p>Need some <a href="https://dataplatform.social/tags/Databricks" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Databricks</span></a> guidance.</p><p>I am encountering the error, "Azure container does not exist" when I use the dbutils.notebook.run() funcion.</p><p>I can navigate the external storage that has been added via Catalog Explorer in Databricks workspace. </p><p>What am I forgetting?</p>
Talk to Me About Tech<p>A very informational article discussing database news across 2024, including the politics of the database market, acquisitions, funding, and other random happenings. <a href="https://www.cs.cmu.edu/~pavlo/blog/2025/01/2024-databases-retrospective.html" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">cs.cmu.edu/~pavlo/blog/2025/01</span><span class="invisible">/2024-databases-retrospective.html</span></a> </p><p><a href="https://hachyderm.io/tags/opensource" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>opensource</span></a> <a href="https://hachyderm.io/tags/technews" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>technews</span></a> <a href="https://hachyderm.io/tags/postgresql" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>postgresql</span></a> <a href="https://hachyderm.io/tags/oracle" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>oracle</span></a> <a href="https://hachyderm.io/tags/databricks" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>databricks</span></a> <a href="https://hachyderm.io/tags/snowflakedb" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>snowflakedb</span></a></p>
Dan<p>Any recommendations for learning <a href="https://c.im/tags/databricks" class="mention hashtag" rel="tag">#<span>databricks</span></a> (on <a href="https://c.im/tags/databricksacademy" class="mention hashtag" rel="tag">#<span>databricksacademy</span></a> or elsewhere) that are geared toward a <a href="https://c.im/tags/DataScientist" class="mention hashtag" rel="tag">#<span>DataScientist</span></a> who loves <a href="https://c.im/tags/R" class="mention hashtag" rel="tag">#<span>R</span></a> / <a href="https://c.im/tags/RStudio" class="mention hashtag" rel="tag">#<span>RStudio</span></a> and isn’t (yet?) fond of <a href="https://c.im/tags/notebooks" class="mention hashtag" rel="tag">#<span>notebooks</span></a>? Looking for something that will showcase how it can “give you superpowers”; currently Databricks seems like a big pile o’ kryptonite (i.e. a huge productivity drag).</p>
Dan<p>Anyone 1) running <a href="https://c.im/tags/Posit" class="mention hashtag" rel="tag">#<span>Posit</span></a> <a href="https://c.im/tags/RStudio" class="mention hashtag" rel="tag">#<span>RStudio</span></a> Server on <a href="https://c.im/tags/Azure" class="mention hashtag" rel="tag">#<span>Azure</span></a> <a href="https://c.im/tags/Databricks" class="mention hashtag" rel="tag">#<span>Databricks</span></a>? Or perhaps 2) connecting to Databricks from RStudio Server running somewhere else?</p><p>Curious to hear about your setup and how well it works.</p><p>Apparently #1 requires that you disable credential passthrough, which IT is saying is a nonstarter. And #2 requires RStudio Server, which is Linux-only. But IT won&#39;t let us use Linux--we can only use a Windows VDI.</p><p>😢</p>
ExploreLive feeds
About