Remove empty lines from a file using Powershell.
secretGeek .:dot Nuts about dot Net:.
home .: about .: sign up .: sitemap .: secretGeek RSS

Remove empty lines from a file using Powershell.

I needed to remove the blank lines from a file.

Normally when I need to do this, I use a regular expression in TextPad. (replace "\r\n\r\n" with "\r\n"... and iterate) -- but TextPad wasn't available on this machine, and I couldn't connect to the internet to grab it.

So I fired up PowerShell and messed around with the syntax until it worked.

gc c:\FileWithEmptyLines.txt | where {$_ -ne ""} > c:\FileWithNoEmptyLines.txt

I don't know if that was the prettiest way to do it -- but I got the result I needed ;-)

The nicest thing was that I didn't need to look anything up -- I just tried variations until I got the result I wanted. I didn't remember the syntax of the 'where' statement or the 'not equal to' operator -- I guessed and got them right within one or two guesses. Nice language design, Bruce!

(I didn't even remember the command 'gc' -- but since i wanted the powershell equivalent of the 'type' command, so i entered 'alias type' and found 'Get-Content' is the powershell equivalent of 'Type' which i guessed was also known as just 'gc')





'http://' on Sun, 18 Mar 2007 23:55:02 GMT, sez:

Reinventing the wheel?
cat FileWithEmptyLines.txt | grep -v ^$ > FileWithNoEmptyLines.txt

or even just:
grep -v ^$ FileWithEmptyLines.txt > FileWithNoEmptyLines.txt

Why do we need another set of shell commands for people to have to remember?



'Bert' on Mon, 19 Mar 2007 00:12:46 GMT, sez:

grep? cat? hello?? not exactly standard on a windows machine.

besides -- powershell does a whole lot more than any unix shell can do.



'lb' on Mon, 19 Mar 2007 00:14:59 GMT, sez:

@{anonymous coward}

>another set of shell commands for people
>to have to remember

no -- you miss the point. I didn't have to remember anything, and i didn't even need to use regular expressions in this case.



'Chris' on Mon, 19 Mar 2007 01:15:56 GMT, sez:

If you type 'Cat' in powershell, then the alias 'Cat' is used which is just an alias to 'Get-Content'

So that is one less thing to have to remember.

Although there's no syntactic equivalent to grep, you could use this syntax:

cat c:\HasEmptyLines.txt | where {$_ -notmatch "^$" } > c:\NoEmptyLines.txt



'lb' on Mon, 19 Mar 2007 01:41:32 GMT, sez:

Here's two ways to measure the length of the resulting file...

$count=0 ;; gc c:\NoEmptyLines.txt | foreach{$count++;} ;; $count


gc c:\NoEmptyLines.txt | Measure-Object



'lb' on Mon, 19 Mar 2007 05:00:23 GMT, sez:

and here's a way to analyze a multi-line string (without putting it into a file first) (and you'd have to escape any double quote chars)

> "
>> cdcdscsdcsdd
>> " | where {$_ -ne "fred"} > c:\fred3.txt
>>


And if the script is going to contain " characters but you don't wanna escape them...

--> Running a Powershell comparison against a multiple line piece of text (without putting it into a file first)
> @"
>> cdcdscsdcsdd
>> "@ | where {$_ -ne "fred"} > c:\fred3.txt
>>



'Barry Kelly' on Mon, 19 Mar 2007 18:19:19 GMT, sez:

@Bert: Unix tools are certainly standard on my machine, can't live without Cygwin.



'lb' on Mon, 19 Mar 2007 23:50:43 GMT, sez:

yeh but barrkel, you're a special case. ;-)

people who work on compilers are generally very far outside any kind of normal consideration.



'hari kiran' on Wed, 10 Oct 2007 03:46:02 GMT, sez:

hi friends i need help in coding



'aaron' on Wed, 23 Apr 2008 19:14:03 GMT, sez:

Yeah, Cygwin rocks!



'nisse' on Wed, 17 Sep 2008 13:03:16 GMT, sez:

no need to use two files for this


(get-content C:\File.txt) | where {$_ -ne ""} | out-file c:\file.txt


will read and write from/to the same file



'Hernan Rojas' on Fri, 15 Apr 2011 22:00:16 GMT, sez:

Here I'am sharing my script which list all domain controllers from my domain and then delete the empty (blank) lines from the generated file:

$file = "\\WDC1A\E$\ScriptsAD\DCList1.txt"
import-module ActiveDirectory
Get-ADDomainController -Server domain.com -Filter * | Sort-Object name | Format-Table name -HideTableHeaders | Out-File $file

Get-Content $file | where {$_.Length -ne 0} | Out-File "$file`.tmp"
Move-Item "$file`.tmp" $file -Force



'Ben Northway' on Tue, 17 Jan 2012 17:02:25 GMT, sez:

My version:
(gc file.txt) | ? {$_.trim() -ne "" } | set-content file.txt

The parenthesis causes the command to finish before proceeding through the pipline. Or else the file would be locked and we couldn't write to it.
The trim() method removes lines that contain spaces but nothing else which is what I needed in my case.

PowerShell is pretty handy!



'Bob Hope' on Thu, 19 Apr 2012 08:35:36 GMT, sez:

Geee... I was looking for this for two days while using google and german language for the search term. Now I tried it in english and the first hit is this website with a working solution...... THX !!




name


website (optional)


enter the word:
 

comment (HTML not allowed)


All viewpoints welcome. But the right to delete any post for any reason is reserved. Don't make me do it. Aim for constructiveness. Comments may be republished, emailed to your loved ones or printed and used as toilet paper. Also, I get particularly nasty on comment spam. It's not worth even trying to post comment spam here -- your html is escaped, and your links are given a rel='nofollow'. By attempting to post a comment, you understand that if the comment is considered spam, at my absolute discretion, your IP address may be used as the target of a prolonged distributed denial of service attack. Your electricity might suddenly stop working. Your car tyres will go mysteriously flat. You will suffer permanent hairloss. Your dreams will be filled with terrifying monsters. And in any case I reserve the right to record and publish your IP address.

 

TimeSnapper is a life analysis system that stores and plays-back your computer use. It makes timesheet recording a breeze, helps you recover lost work and shows you how to sharpen your act.

 

NimbleText - FREE text manipulation and data extraction

NimbleText is a Powerful FREE Tool

Use it for:

  • extracting data from text
  • manipulating text
  • generating code

It makes you look awesome. Use it right now! Go on! Hurry! Don't walk, run!

 

Articles

Just Wally Just Wally
The Correct Order for a First Time Viewing of The Lord Of The Rings The Correct Order for a First Time Viewing of The Lord Of The Rings
A new era for Android. A new era for Android.
Mind-boggling Demo of New Gaming Genre, aka Folder-Based Hangman, aka Fun with Recursion Mind-boggling Demo of New Gaming Genre, aka Folder-Based Hangman, aka Fun with Recursion
Got CSV in your javascript? Use agnes. Got CSV in your javascript? Use agnes.

Archives Complete secretGeek Archives

TimeSnapper -- Automated Screenshot Journal TimeSnapper: automatic screenshot journal
NimbleText -- World's Simplest Code Generator NimbleText: Code Generator, Text Manipulator, Data Extractor

25 steps for building a Micro-ISV 25 steps for building a Micro-ISV
3 minute guides -- babysteps in new technologies: powershell, JSON, watir, F# 3 Minute Guide Series
Universal Troubleshooting checklist Universal Troubleshooting Checklist
Top 10 SecretGeek articles Top 10 SecretGeek articles
ShinyPower (help with Powershell) ShinyPower
Now at CodePlex

Realtime CSS Editor, in a browser RealTime Online CSS Editor
Gradient Maker -- a tool for making background images that blend from one colour to another. Forget photoshop, this is the bomb. Gradient Maker


[powered by Google] 


How to be depressed How to be depressed
You are not inadequate.



Recommended Reading


the little schemer


The Best Software Writing I
The Business Of Software (Eric Sink)

Recommended blogs

Jeff Atwood
Joseph Cooney
Phil Haack
Scott Hanselman
Julia Lerman
Rhys Parry
Joel Pobar
Thomas White
OJ Reeves
Eric Sink

Aggregated Links

proggit
dzone
hacker news
dot net kicks

Human Link Machines

interesting finds
a continuous learner's weblog
arjan's world
weekly link post

LinkedIn profile
LogEnvy - event logs made sexy
Computer, Unlocked. A rapid computer customization resource
PhysioTec, Brisbane Specialist Physiotherapy & Pilates
 
home .: about .: sign up .: sitemap .: secretGeek RSS .: © Leon Bambrick 2006 .: privacy

home .: about .: sign up .: sitemap .: RSS .: © Leon Bambrick 2006 .: privacy