How to Ingest Databricks Data into DataRobot Create a Databricks Data Connection

>> YOUR LINK HERE: ___ http://youtube.com/watch?v=ueI0poTLj3Y

Databricks users can ingest data from Databricks directly into DataRobot after creating a one-time data connection. This video shows how to create the data connection, how to test it and how to use it to pull data from Databricks in DataRobot or push data from Databricks to DataRobot. • Learn more at: • https://docs.datarobot.com/en/docs/ap... • Content • Organizations using Databricks for data processing can use DataRobot for machine learning activities on Databricks data sets very easily. In order to ingest data from Databricks we will need the JDBC URL to the Databricks cluster. • This video will also show how we can adjust data into DataRobot using Databricks notebooks. We can find the JDBC URL under the configuration settings of the Databricks cluster. • Go to Advanced Options. JDBC/ODBC. And this is the URL. Create your personal access token using the settings, and generate a new token. Let us now ingest data from Databricks into DataRobot. For this first create the data connection. Add Data Connection. My Drivers. Let's select the driver. Paste the URL. So just copy the password we'll use it later. • Let us test the connection. The password is the token that we copied earlier. And the connection is successful. Let us go back to AI Catalog. Add to Catalog. Existing Data Connection. Let us select the credentials. DataRobot is now connecting to the instance of Databricks. Let us select the table. And proceed with registration. As you can see DataRobot is now pulling in the data from Databricks. And the table is now ready. • Let us see how to do the same with DataRobot API. First we connect the DataRobot instance. Then we define our cluster URL. We create our credentials. We select our driver. Create the data connection. Test the data connection. Send a query, and get the table. • Let us see how to publish data from Databricks to DataRobot. Here is our PySpark data frame. We convert it into a pandas data frame. We connect to our DataRobot instance, and publish the data set. • • Stay connected with DataRobot! • ► Blog: https://blog.datarobot.com/ • ► Community: https://community.datarobot.com/ • ► Twitter: / datarobot • ► LinkedIn: / datarobot • ► Facebook: / datarobotinc • ► Instagram: / datarobot

#############################

New on site