Register
Courses Courses Feedback Feedback

Logstash takes more than 48 hours to ingest 10 GB CSV file. Is there a way to expedite?

1,225 views
4 4 votes
I have a 10 GB CSV file and it takes more than 48 hours for logstash installed on my laptop to ingest the whole data. Is there a way to accelerate this process?
29% Accept Rate Accepted 2 answers out of 7 questions

1 Answer

1 1 vote

It depends on your system processing power and the way you configure Logstash. If you make more outputs streams it will take longer. Please take a look at this link to see how you can tune the configurations. More than that, you can see some nice tips here.

Related questions

1 1 vote
1 1 answer
1.0k
1.0k views
Ghassem asked Feb 27, 2020
1,018 views
How to directly download a file into HDFS?
Is there any way to download a file directly into HDFS?
3 3 votes
1 1 answer
849
849 views
Math asked Sep 28, 2018
849 views
Is there any easy way to draw the Truth Table for logic expressions?
I can solve the Truth Table, but do not know how to verify my answers. Could you please suggest a tool for it?
0 0 votes
1 1 answer
452
452 views
Doge asked Sep 20, 2018
452 views
When building a text to speech application, which factor is more important, recognition or recall?
0 0 votes
1 1 answer
894
894 views
rakesh asked Feb 10, 2020
894 views
How to map (string compare) a string with 10000+ strings in DB? which is the best way to do it?
I have a result string like this A, C, D, F, B,In my DB I have 10,000+ combinations like this 1. A, B, C, D 2. A, C, B, I, D, W, Z etc.... Now I want to search for my ...
1 1 vote
1 1 answer
595
595 views
paralkar asked Dec 17, 2018
595 views
What is the easiest way to distinguish whether to use a z value test or a t value test?
Voting & Accepting an answer helps improve the community