Deleting Lines with Matching Pattern from a File in Linux

Handling files is a key skill in learning Linux, especially when you need to delete lines that match a certain pattern. You can do this using tools like grep, sed, and awk on the command line. In this article, we’ll show you how to use these tools to search for and remove specific lines from a file in Linux.

Before you start: Always make a backup of your files before making changes. Remember, there is no ‘undo’ button in the command line, so if you delete something by mistake, you won’t be able to recover it.

Advertisement

1. Using grep

grep is a utility that searches for text patterns within files. Although it’s primarily used for searching, we can also use it to remove lines that match a specific pattern.

Let’s say we want to remove all lines containing the word “Linux” from a file named example.txt. Here’s how to do it:

1. Open your terminal.
2. Run the following command:

   grep -v "Linux" example.txt > temp.txt && mv temp.txt example.txt 
   

This command does a couple of things. The -v option inverts the search, which means it matches all lines not containing the word “Linux”. The output is redirected (>) to a temporary file called temp.txt. The && operator is a command conjunction that executes the second command (`mv temp.txt example.txt`) only if the first command was successful.

2. Using sed

sed (stream editor) is a powerful and versatile utility used to perform transformations on text in a file.

To delete lines that match a pattern, use the d command with sed. The d command in sed is used to delete lines.

Let’s delete all lines containing the pattern “Linux” from the file example.txt:

sed '/Linux/d' example.txt > temp.txt && mv temp.txt example.txt 

The ‘/Linux/d’ command tells sed to delete all lines matching the pattern “Linux”. The output is again redirected to a temporary file and moved back to the original file.

If you want to make changes directly to the file, use the -i option, like so:

sed -i '/Linux/d' example.txt 

3. Using awk

awk is a versatile programming language designed for pattern scanning and processing language.

Here’s how you can use awk to delete lines matching a pattern:

awk '!/Linux/' example.txt > temp.txt && mv temp.txt example.txt 

In the awk command, ‘!/Linux/’ means “find lines not matching ‘Linux'”, and it’s outputting those lines to temp.txt, excluding the lines with “Linux”. After that, it moves temp.txt to example.txt.

Conclusion

In conclusion, mastering file manipulation on Linux is a valuable skill that enhances your efficiency when working with files. Using tools like grep, sed, and awk allows you to handle files precisely and effectively. Remember, it’s important to always back up your files before making changes, as the command line does not offer an ‘undo’ function. With practice, you’ll find these commands increasingly intuitive and essential for your Linux tasks.