Under the topic of fetching data we covered how to obtain data from diverse local and remote sources, and also how to extract them from sophisticated file formats and systems. We also learned how to generate simple synthetic data. If you ever encounter a file format or system we haven’t covered don’t worry. It’s almost certain that you’ll be able to find command-line tools that can process it using the principles we learned together.

We’re now ready to move to the next part of our processing pipeline, which involves the selection of the data we want to process.