1 Use the UNIX shell to wrangle log data
mebaumb редактировал(а) эту страницу 2021-04-22 17:33:34 -07:00

Event Information

Category Details
Reactor Topic DevOps and Dev Tools
Level Beginner
Title Use the UNIX shell to wrangle log data
Description Transforming data from one format to another is a very common task for developers. You often have to deal with raw data that needs to be manipulated or transformed to be useable. In this session, we'll walk through how to wrangle - or transform - data using the UNIX shell. You'll be introduced to some commonly used tools and to the basics of regular expressions (regex). You'll learn commands to help you do basic file inspections, create and append files, do pattern matching and basic text transformations. This is a beginner's workshop, but it is recommended that you have some familiarity with the command line and basic shell commands.
Content https://aka.ms/UNIXShellData-8

Workshop Dates Run:

May 4 - 7, 2021 - All Locations

Instructor notes

Share this link with attendees at the beginning of the workshop: https://aka.ms/UNIXShellData-8

Let them know this is the content that will be covered, and that following the workshops they should step through to complete the module, including answering the knowledge check questions and rating the module.

This workshop will teach learners how to use the UNIX shell to wrangle data and inspect data files.

Workshop steps:

  1. Perform file inspection in the UNIX shell. Remind attendees that they need an Azure account. This unit uses the Cloud Shell within the unit as a sandbox. Walk through the steps, running the commands in the shell to get familiar with using the terminal to explore files.
  2. Basic file manipulation with the cat command. Get familiar with the cat command to display and create content.
  3. Introduction to regular expressions. Talk about the importance of using regex and share helpful resources such as: https://regex101.com/. Walk through the most commonly used regular expressions
  4. Use the grep command to match regular expressions Explain and demonstrate how the grep command works.
  5. Introduction to the stream editor. Get familiar with the sed tool for text parsing and manipulation.
  6. Use pipes and filters to put it all together. Use all the concepts from this module to inspect files and manipulate data.

Wrapping up:

  • Walk through the knowledge check questions with attendees
  • Remind attendees to complete the knowledge check and summary so they can get a badge for completing the module. Also please encourage them to rate the module 😄
  • Share out the survey link: https://aka.ms/Reactor/Survey with the event code (the Reactor contact on the call can give you this)