Golang : Read tab delimited file with encoding/csv package
This tutorial is just a slight modification from previous tutorial on how to read CSV file and save the result to JSON format file. In this tutorial, we will learn how to instruct the Golang's CSV reader to recognize the tab character '\t'
instead of ,
comma as separator.
To do that, we need to change the type Reader.Comma (https://golang.org/pkg/encoding/csv/#Reader) default value from ','
to '\t'
with this line :
reader.Comma = '\t' // Use tab-delimited instead of comma
and if you are looking to write out tab delimited file instead of comma, remember to change the default value for type Writer.Comma (https://golang.org/pkg/encoding/csv/#Writer) as well.
Let's see how it goes.
We will process the tabdata.csv file
Adam 36 CEO
Eve 34 CFO
Mike 38 COO
with this code :
package main
import (
"encoding/csv"
"encoding/json"
"fmt"
"os"
"strconv"
)
type Employee struct {
Name string
Age int
Job string
}
func main() {
// read data from CSV file
csvFile, err := os.Open("./tabdata.csv")
if err != nil {
fmt.Println(err)
}
defer csvFile.Close()
reader := csv.NewReader(csvFile)
reader.Comma = '\t' // Use tab-delimited instead of comma <---- here!
reader.FieldsPerRecord = -1
csvData, err := reader.ReadAll()
if err != nil {
fmt.Println(err)
os.Exit(1)
}
var oneRecord Employee
var allRecords []Employee
for _, each := range csvData {
oneRecord.Name = each[0]
oneRecord.Age, _ = strconv.Atoi(each[1]) // need to cast integer to string
oneRecord.Job = each[2]
allRecords = append(allRecords, oneRecord)
}
jsondata, err := json.Marshal(allRecords) // convert to JSON
if err != nil {
fmt.Println(err)
os.Exit(1)
}
// sanity check
// NOTE : You can stream the JSON data to http service as well instead of saving to file
fmt.Println(string(jsondata))
// now write to JSON file
jsonFile, err := os.Create("./data.json")
if err != nil {
fmt.Println(err)
}
var oneRecord Employee
var allRecords []Employee
for _, each := range csvData {
oneRecord.Name = each[0]
oneRecord.Age, _ = strconv.Atoi(each[1]) // need to cast integer to string
oneRecord.Job = each[2]
allRecords = append(allRecords, oneRecord)
}
jsondata, err := json.Marshal(allRecords) // convert to JSON
if err != nil {
fmt.Println(err)
os.Exit(1)
}
// sanity check
// NOTE : You can stream the JSON data to http service as well instead of saving to file
fmt.Println(string(jsondata))
// now write to JSON file
jsonFile, err := os.Create("./data.json")
if err != nil {
fmt.Println(err)
}
defer jsonFile.Close()
jsonFile.Write(jsondata)
jsonFile.Close()
}
run the code above and the output will be stored in the data.json file with the following data :
[{"Name":"Adam","Age":36,"Job":"CEO"},{"Name":"Eve","Age":34,"Job":"CFO"},{"Name":"Mike","Age":38,"Job":"COO"}]
Hope this is useful to you.
References :
https://www.socketloop.com/tutorials/golang-convert-csv-data-to-json-format-and-save-to-file
See also : Convert JSON to CSV in Golang
By Adam Ng
IF you gain some knowledge or the information here solved your programming problem. Please consider donating to the less fortunate or some charities that you like. Apart from donation, planting trees, volunteering or reducing your carbon footprint will be great too.
Advertisement
Tutorials
+6.4k Grep : How to grep for strings inside binary data
+7.8k Golang Hello World Example
+7.2k Golang : File system scanning
+5.2k Golang : Get FX sentiment from website example
+18k Golang : Check if a directory exist or not
+5.1k Python : Create Whois client or function example
+5.6k Fix yum-complete-transaction error
+5.6k Fix fatal error: evacuation not done in time problem
+19.3k Golang : Fix cannot download, $GOPATH not set error
+11.9k Golang : Clean formatting/indenting or pretty print JSON result
+7.3k Golang : Check to see if *File is a file or directory