Site icon Spark By {Examples}

Export Pandas to CSV without Index & Header

Naveen Nelamali
pandas csv without index

In order to export Pandas DataFrame to CSV without an index (no row indices) use param index=False and to ignore/remove header use header=False param on to_csv() method. In this article, I will explain how to remove the index and header on the CSV file with examples. Note that this method also supports several other parameters to write Pandas DataFrame to CSV file.

1. Pandas to CSV without Index & Header

By default exporting a Pandas DataFrame to CSV includes column names on the first row, row index on the first column, and writes a file with a comma-separated delimiter to separate columns. Pandas.DataFrame.to_csv() method provides parameters to ignore an index and header while writing.

First, let’s create a DataFrame with a few rows and columns along with index and header names. 


# Create a DataFrame
import pandas as pd
import numpy as np
technologies = {
    'Courses':["Spark","PySpark","Hadoop","Python"],
    'Fee' :[22000,25000,np.nan,24000],
    'Duration':['30day',None,'55days',np.nan],
    'Discount':[1000,2300,1000,np.nan]
          }
df = pd.DataFrame(technologies)
print("Create DataFrame:\n", df)

Yields below output.

pandas csv without index

2. Pandas to CSV with no Index

Pandas DataFrame to CSV with no index can be done by using a index=False param of to_csv() method. With this, you can specify ignore index while writing/exporting DataFrame to a CSV file.


# Remove column header and index
df.to_csv("c:/tmp/courses.csv",index=False)

Writes courses.csv file without index.


# Output:
Courses,Fee,Duration,Discount
Spark,22000.0,30day,1000.0
PySpark,25000.0,,2300.0
Hadoop,,55days,1000.0
Python,24000.0,,

3. Pandas to CSV without Header

To write DataFrame to CSV without a column header (remove column names) use header=False param on to_csv() method.


# Remove header while writing
df.to_csv("c:/tmp/courses.csv",header=False)

Writes courses.csv file as.


# Output:
0,Spark,22000.0,30day,1000.0
1,PySpark,25000.0,,2300.0
2,Hadoop,,55days,1000.0
3,Python,24000.0,,

4. Export without Index and Header

Let’s combine these and see how you can use both removing index and column names on the CSV files.


# Remove header & index while writing
df.to_csv("c:/tmp/courses.csv",header=False, index=False)

Conclusion

In this quick article, you have learned how to remove the header without column names and index while writing DataFrame to a CSV file. Use param header=False to remove columns and use index=False to remove index (no row indices) on to_csv() method.

Happy Learning !!

References

Exit mobile version