Working with CSV files

3 min read • Updated Jan 2024 • Peer-Reviewed Learning Resource

Working with CSV (Comma-Separated Values) files is a common task in data analysis and manipulation using Python. CSV files are widely used for storing tabular data, making them accessible and easily readable. In this chapter, we’ll explore how to read from and write to CSV files using Python, a skill crucial for next-generation biologists involved in data-driven research.

Reading from CSV Files:
Python provides a convenient module called csv for handling CSV files. Let’s explore the basic steps for reading data from a CSV file.

Pyton

				import csv

# Specify the path to your CSV file
csv_file_path = 'your_data.csv'

# Open the CSV file
with open(csv_file_path, 'r') as file:
    # Create a CSV reader
    csv_reader = csv.reader(file)

    # Iterate through each row in the CSV file
    for row in csv_reader:
        # Process each column in the row
        for column in row:
            print(column, end=' ')
        print()  # Move to the next line for the next row

import csv

# Specify the path to your CSV file
csv_file_path = 'your_data.csv'

# Open the CSV file
with open(csv_file_path, 'r') as file:
    # Create a CSV reader
    csv_reader = csv.reader(file)

    # Iterate through each row in the CSV file
    for row in csv_reader:
        # Process each column in the row
        for column in row:
            print(column, end=' ')
        print()  # Move to the next line for the next row

In this example, we open the CSV file, create a CSV reader, and then iterate through each row and column, printing the contents. You can customize the code to suit your specific data analysis needs.

Writing to CSV Files:
Writing data to a CSV file is as straightforward as reading from one. Here’s a simple example:

Pyton

				import csv

# Specify the path to your CSV file
csv_file_path = 'output_data.csv'

# Data to be written to the CSV file
data_to_write = [
    ['Name', 'Age', 'Occupation'],
    ['John', 28, 'Biologist'],
    ['Jane', 25, 'Geneticist'],
    ['Alex', 30, 'Bioinformatician']
]

# Open the CSV file in write mode
with open(csv_file_path, 'w', newline='') as file:
    # Create a CSV writer
    csv_writer = csv.writer(file)

    # Write data to the CSV file
    for row in data_to_write:
        csv_writer.writerow(row)

print(f'Data has been written to {csv_file_path}')

import csv

# Specify the path to your CSV file
csv_file_path = 'output_data.csv'

# Data to be written to the CSV file
data_to_write = [
    ['Name', 'Age', 'Occupation'],
    ['John', 28, 'Biologist'],
    ['Jane', 25, 'Geneticist'],
    ['Alex', 30, 'Bioinformatician']
]

# Open the CSV file in write mode
with open(csv_file_path, 'w', newline='') as file:
    # Create a CSV writer
    csv_writer = csv.writer(file)

    # Write data to the CSV file
    for row in data_to_write:
        csv_writer.writerow(row)

print(f'Data has been written to {csv_file_path}')

In this example, we create a CSV writer and use the writerow method to write rows of data to the file.

Additional Considerations:
Handling Headers:
When working with CSV files that have headers, you can use the csv.DictReader and csv.DictWriter classes to work with dictionaries, making it easier to reference columns by their header names.

Delimiters:
While CSV files are typically comma-separated, sometimes they may use a different delimiter. You can specify the delimiter when creating the csv.reader or csv.writer objects.

Dealing with Large Datasets:
For large datasets, consider using the pandas library, which provides efficient data structures for handling and analyzing tabular data, including CSV files.

Remember to adapt these examples to your specific use case, incorporating them into your bioinformatics workflows for effective data management and analysis.

← Return to Home Hub Scroll to Top ↑