Golang : Not able to grep log.Println() output
Problem:
You have a Golang program that uses log.Println()
to capture text output generated by your program and you want to pipe the output to grep
command. Mysteriously, it is not working as expected. What's going on?
Solution and notes:
The underlying code behind log.Println()
uses fmt.Sprintln()
(see https://golang.org/src/log/log.go?s=8792:8822#L284) while fmt.Println()
uses Fprintln()
function. (see https://golang.org/src/fmt/print.go?s=7388:7437#L246)
The difference is that Fprintln()
writes to io.Writer, while Sprintln()
does not.
io.Writer will pipe text output to grep
command via the Unix/Linux's |
.
It is ok to use log.Println()
if you expect the log messages to be short or one line. Do not use log.Println()
to capture text output if it is going to be long - such as HTML.
Run the code example below and try to grep
the lines with page
generated by log.Println()
versus fmt.Println()
. You will see the differences immediately.
package main
import (
"fmt"
"io/ioutil"
// "log"
"net/http"
"os"
)
func main() {
// http.Get() can handle gzipped data response
// automagically
resp, err := http.Get("https://golang.org")
if err != nil {
fmt.Println(err)
os.Exit(1)
}
defer resp.Body.Close()
htmlData, err := ioutil.ReadAll(resp.Body)
if err != nil {
fmt.Println(err)
os.Exit(1)
}
//log.Println(string(htmlData)) //<-- grep will not work
fmt.Println(string(htmlData)) //<-- grep will work
}
Output with fmt.Println()
:
./grepalog | grep "page"
<div id="page">
the content of this page is licensed under the
</div><!-- #page -->
By Adam Ng
IF you gain some knowledge or the information here solved your programming problem. Please consider donating to the less fortunate or some charities that you like. Apart from donation, planting trees, volunteering or reducing your carbon footprint will be great too.
Advertisement
Tutorials
+4.2k Golang : Pad file extension automagically
+13.9k Golang : Find location by IP address and display with Google Map
+17.7k Golang : convert int to string
+12.8k Elastic Search : Mapping date format and sort by date
+5.2k Golang : Process non-XML/JSON formatted ASCII text file example
+6k Golang : Get Alexa ranking data example
+14.2k Golang : Delete certain files in a directory
+6.1k Golang : Accessing dataframe-go element by row, column and name example
+12.9k Golang : Google Drive API upload and rename example
+16.8k Golang : Check if a directory exist or not
+13.1k Golang : Overwrite previous output with count down timer
+8.1k Golang : Detect number of active displays and the display's resolution