How to Convert Dataframes into Xml files on Spark.

In this tutorial, we are going to work on Databricks community edition and use spark-xml library. For going though the tutorial, we are going use a csv that is stored into a folder on databricks community. If you need further information, please go to the … “How to Convert Dataframes into Xml files on Spark.”

Read More

What datasets could we use for learning data processing on Spark.

An issue that we have when we are starting to learn spark is that there is not much information on datasets available for working on them. I found that there is an interesting dataset that is being maintained by databricks team. You can check its … “What datasets could we use for learning data processing on Spark.”

Read More

How to Convert a Dataframe into a Table in Apache Spark

In this tutorial, we are going to work on Databricks community edition and convert a dataframe into a table using Apache spark. We are going to use a dataset that is stored in Databricks Community. If you want more information about the datasets on databricks … “How to Convert a Dataframe into a Table in Apache Spark”

Read More

How to read Csv files in Spark

In this tutorial, we are going to work on Databricks community edition and read a csv file using Spark. For going through the tutorial, we are going to upload a csv file from the following dataset. https://www.ecdc.europa.eu/en/publications-data/data-daily-new-cases-covid-19-eueea-country. For completing the task, please follow the next … “How to read Csv files in Spark”

Read More