Register
Courses Courses Feedback Feedback

How to directly download a file into HDFS?

1,017 views

1 Answer

0 0 votes

Yes, please use curl as follows:

curl -sS https://www.google.com/robots.txt | hadoop fs -put - /robots.txt

It downloads the robots.txt file and put it directly to /robots.txt on your HDFS. You can check it by running the following command afterward:

hadoop fs -ls /

Related questions

1 1 vote
1 1 answer
2.2k
2.2k views
machinelearning asked Oct 3, 2018
2,233 views
How to use Amazon Web Services (AWS) for free as a student?
Is there any way to use AWS for free?
4 4 votes
1 1 answer
1.2k
1.2k views
askdatascience asked Oct 14, 2018
1,225 views
Logstash takes more than 48 hours to ingest 10 GB CSV file. Is there a way to expedite?
I have a 10 GB CSV file and it takes more than 48 hours for logstash installed on my laptop to ingest the whole data. Is there a way to accelerate this process?
0 0 votes
0 0 answers
1.8k
1.8k views
Harshini asked Feb 7, 2020
1,829 views
How to add delimiter to an existing table in HIVE so as to get proper table format data ?
When I am using the select statement to display my data in hive. It displays my data in scattered format. I want to add a delimiter so that when data is been displayed it...
1 1 vote
1 1 answer
2.8k
2.8k views
tofighi asked Feb 4, 2020
2,812 views
How to see Hive terminal history of commands?
Is it possible to take a look at list of all commands written for Apache Hive?
1 1 vote
2 answers 2 answers
2.5k
2.5k views
Ghassem asked Jan 30, 2020
2,493 views
How to activate hive interpreter for Apache Zeppelin on Dataproc on GCP?
Hive is not enabled by default on GCP on Apache Zeppelin on Dataproc on GCP. How can we activate it?
Voting & Accepting an answer helps improve the community