Week twelve Activities: Upload data into HDInsight Microsoft Storage Account from local machine using Powershell

In this implementation part, I am going to demonstrate how to upload files from local machine to HDInsihgt Microsoft Azure Storage account using the command prompt.

Step 1: Open your Windows Powershell. Run as Administrator

1

2

Step 2: Run the following script to upload data from local machine to HDInsihgt Hadoop HDFS default file system. I am going to upload 5 CSV files from January to May 2017 flight delay performance data. I downloaded that data from the websites :

https://www.transtats.bts.gov/DL_SelectFields.asp?Table_ID=236&DB_Short_Name=On-Time

Sytax: pscp file-location.format-of-file username@hostname:/location
pscp E:\newdata\01.csv sshuser@flightdelayh-ssh.azurehdinsight.net:

Step 3: CSV data uploaded to HDInsight storage through SCP protocol

3

Thank you 🙂

 

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s