Read parquet file via data lake connector in Incorta

Incorta allow to read parquet file, this is how to read parquet file via data lake connector in Incorta.

 Step 1: Save the parquet file in external notebooks(Jupyter notebooks)


Step 2: In Incorta external data source, Add a new data source.


Step 3: Select 'data lake - local files', give directory path.


Step 4: Go to Incorta Schema add a new data lake table.






Comments

Post a Comment

Popular posts from this blog

How to create histogram in Incorta use bin function.

Image
The  Ecommerce_Customer schema has four variables, Time On App, Time On Website, Length Of Membership, and Yearly Amount Spent. I want to see the distribution of these data. Incorta let me preview the data and show max and min data of each using its Preview function. Here are the steps I used to create a histogram in Incorta. First,  I used the bin function in Incorta divided into different levels. Here is the documentation for the bin function.        https://docs.incorta.com/4.5/r-bin Here is the result of the bin function. I divided the average of session length into 6 levels. If the length is less than 30, it will be labeled as 'SLV1', and if the length is greater than 30 but less than 32, it will be labeled as 'SLV2', by basically, according to the min and max value. I see the minimum value is close to 30, and the maximum value close to 38. I decided to use 2 minutes as the interval and created the formula using the bin function. I'm grouping...
Read more

Using Time Series Analysis Electric Production by ARIMA Model

Image
I got the dataset from Kaggle for practicing time series analysis.  https://www.kaggle.com/kandij/electric-production    The data set used here has 2 columns, one column is the date and the other column relates to the consumption percentage. It includes the data from Dec 31,1984 to Dec 31,2017. For predicting the consumption of electricity in the coming future.  I loaded data into Incorta, and use the Incorta API to read the data from Jupyter notebook. I save the model in the external notebook and use data in Incorta.  First, I import data to Incorta. Then I use the Incorta API to read the data in Jupyter notebooks. Then, I use the model in Incorta.  Here is the result in Incorta. The blue line showing original data, and the green line showing predict electric production. 
Read more