Chapter 1: Next-Generation Sequencing Technology: Types, Principles & RNA-Seq File Formats
1. Foundations of Next-Generation Sequencing in Transcriptomics
Transcriptomics quantifies the complete set of RNA transcripts produced by the genome under specific physiological conditions, developmental stages, or therapeutic perturbations. Understanding gene expression begins at the physical sequencing flowcell. Modern high-throughput sequencing converts microscopic cDNA or RNA molecules into digital nucleotide reads through four dominant technological paradigms:
| Platform / Technology | Sequencing Chemistry | Read Length & Profile | Primary Biomedical Applications | Typical Error Rate |
|---|---|---|---|---|
| Illumina NovaSeq / NextSeq | Sequencing-by-Synthesis (SBS) with reversible fluorescent dye terminators | Short reads: 2x50 bp, 2x100 bp, 2x150 bp paired-end | High-throughput bulk differential expression, rare transcript discovery, clinical diagnostics | < 0.1% (predominantly substitution) |
| MGI DNBSeq (G400/T7) | DNA Nanoball (DNB) rolling-circle amplification + Combinatorial Probe-Anchor Synthesis (cPAS) | Short reads: SE50, PE100, PE150 | Large-scale population transcriptomics, cost-effective clinical gene expression panels | < 0.1% (low optical index hopping) |
| Pacific Biosciences (PacBio Revio) | Single-Molecule Real-Time (SMRT) sequencing (HiFi circular consensus) | Long reads: 10–25 kb accurate consensus reads | Full-length isoform profiling (Iso-Seq), alternative splicing, novel transcript discovery | < 0.1% (Q30+ consensus accuracy) |
| Oxford Nanopore (PromethION) | Electrochemical measurement of ionic current disruption through protein nanopores | Ultra-long reads (up to Mb) + Direct RNA sequencing | Native direct RNA modification detection (m6A, pseudouridine), real-time pathogen surveillance | ~ 1–3% (raw error rate) |
2. RNA Library Preparation: Poly(A)+ vs. Ribo-Zero vs. Small RNA
Total human RNA consists of roughly 80–90% ribosomal RNA (28S, 18S, 5.8S, and 5S rRNA), 10–15% transfer RNA (tRNA), and only 1–4% protein-coding messenger RNA (mRNA). Sequencing total RNA without depletion or enrichment would result in over 90% of sequencing reads aligning uselessly to rRNA operons. Two primary library preparation strategies dominate biomedical research:
Strategy A: Poly(A)+ Oligo(dT) Magnetic Bead Selection
Magnetic beads conjugated with synthetic oligo(dT) oligonucleotides selectively hybridize to the 3' polyadenylated tails of mature, eukaryotic mRNAs.
- Pros: Highly cost-effective; yields maximum sequencing depth for protein-coding genes.
- Cons: Excludes non-polyadenylated long non-coding RNAs (lncRNAs), histone mRNAs, and degrades severely in formalin-fixed paraffin-embedded (FFPE) archival biopsies where RNA integrity number (RIN) is < 6.
Strategy B: Ribosomal RNA Depletion (Ribo-Zero / Total RNA-Seq)
Sequence-specific DNA probes complementary to 28S, 18S, 5.8S, 5S, and mitochondrial 12S/16S rRNAs hybridize to rRNA, followed by enzymatic digestion with RNase H or magnetic bead subtraction.
- Pros: Captures entire non-coding transcriptome (lncRNAs, circular RNAs, snRNAs) and functions robustly on partially degraded clinical FFPE tissue samples (RIN ≥ 2).
- Cons: Requires 1.5x–2x higher sequencing depth (50–80 million reads per sample) to attain equal protein-coding coverage.
3. RNA-Seq File Architecture: From FASTQ to Digital Count Matrices
Processing transcriptomic data requires transitioning through four standardized file formats. Each format represents a distinct milestone in the computational pipeline:
# The 4 Core Stages and File Formats of Biomedical RNA-Seq
[ 1. Raw Reads ] FASTQ.GZ (Base calls + Phred quality scores Q = -10 * log10(P))
│
▼ (Alignment via STAR / HISAT2 or Quasi-mapping via Salmon / Kallisto)
[ 2. Alignments ] BAM / SAM (Genomic coordinates, CIGAR strings, spliced junction tags)
│
▼ (Quantification against GTF/GFF3 gene models via featureCounts / HTSeq)
[ 3. Annotations ] GTF / GFF3 (Exon boundaries, transcript IDs, gene biotypes)
│
▼ (Aggregation into statistical modeling matrix)
[ 4. Count Matrix ] TSV / RDS (Rows = Gene Symbols / Ensembl IDs; Columns = Patient Samples)The Four-Line Anatomy of a FASTQ Entry
Each sequenced read in a FASTQ file is represented by exactly four lines:
@A00123:456:H5WNYDSX2:1:1101:1020:1000 1:N:0:ATCACG
NATCGATCGATCGATCGATCGTAGCTAGCTAGCTAGCTAGCTAGCTAGCTAAGCTAGCTA
+
#FFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFFF- Line 1 (Header): Instrument ID (
@A00123), Run number (456), Flowcell ID (H5WNYDSX2), Lane (1), Tile (1101), X/Y coordinates (1020:1000), Read pair (1), Filter flag (N= passed), and Multiplex Index barcode (ATCACG). - Line 2 (Sequence): Raw base calls (A, C, T, G, and N for ambiguous bases).
- Line 3 (Separator): Plus sign (
+), optionally repeating the header. - Line 4 (Quality Scores): ASCII characters representing Phred quality scores where character
Irepresents Q40 (1 error in 10,000 bases) and#represents Q2 (high probability of error).
Practical Command-Line: Verifying Strandedness and Read Metrics
# 1. Inspect first 2 reads from paired-end FASTQ files
zcat sample_tumor_R1.fastq.gz | head -n 8
# 2. Check total read count in gzipped FASTQ file
echo $(zcat sample_tumor_R1.fastq.gz | wc -l) / 4 | bc
# 3. Infer strandedness (Forward, Reverse, or Unstranded) using RSeQC or check_strandedness
# In modern dUTP / TruSeq Stranded protocols, reads are almost universally Reverse (RF / fr-firststrand)
check_strandedness -g Homo_sapiens.GRCh38.112.gtf \
-r1 sample_tumor_R1.fastq.gz \
-r2 sample_tumor_R2.fastq.gzCommon Pitfalls & Troubleshooting Checklist
- Java Heap Exhaustion (GATK / Picard): If processes terminate with
java.lang.OutOfMemoryError, set your environment variable explicitly:export _JAVA_OPTIONS="-Xmx16g -Djava.io.tmpdir=/tmp". - Index Timestamp Mismatch: If tools complain that a BAM index is missing or out of date, regenerate with
samtools index -@ 4 sample.bam. - Conda Channel Conflicts: Avoid ABI incompatibilities between bioconda and conda-forge by setting strict priority:
conda config --set channel_priority strict. - Chromosome Naming Contamination: Always verify whether reference FASTA headers use
chr1or1; divergent naming causes silent alignment drops.