You can access log file data, sensor data, Supervisory Control And Data Acquisition (SCADA) data, message bus data, Programmable logic controller (PLC) data on the Spark SQL engine in the Hadoop environment or Databricks Spark SQL engine in the Databricks environment.
You can create physical data objects to access the different types of data. Based on the type of target you are writing to, you can create the relevant data objects.