Giter Site home page Giter Site logo

canceromics / meripseqpipe Goto Github PK

View Code? Open in Web Editor NEW
30.0 2.0 18.0 38.95 MB

MeRIPseqPipe:An integrated analysis pipeline for MeRIP-seq data based on Nextflow.

License: MIT License

Dockerfile 0.75% HTML 1.27% R 27.54% Shell 11.79% Perl 8.24% Python 3.27% Groovy 3.32% Nextflow 43.82%

meripseqpipe's Introduction

MeRIPseqPipe

MeRIP-seq analysis pipeline arranged multiple alignment tools, peakCalling tools, Merge Peaks' methods and methylation analysis methods.

Nextflow check in Biotreasury install with bioconda Docker

Introduction

Here, we present MeRIPseqPipe, an integrated analysis pipeline for MeRIP-seq data based on Nextflow. It integrates ten main functional modules including data preprocessing, quality control, read mapping, peak calling, peak merging, motif searching, peak annotation, differential methylation analysis, differential expression analysis, and data visualization, which covers the basic analysis of MeRIP-seq data.

All the analysis modules are generated by Nextflow, and all the third-party tools are encapsulated in the Docker container.

Quick Start

  1. install nextflow

  2. pull docker image from dockerhub: kingzhuky/meripseqpipe:dev

  3. cloning this repository

    git clone https://github.com/canceromics/MeRIPseqPipe.git
    nextflow run /path/to/MeRIPseqPipe --help
  4. test it on a minimal dataset with a single command

    nextflow run path/to/meripseqpipe -profile test,docker
  5. Start running your own analysis!

    nextflow run path/to/meripseqpipe -profile docker --designfile designfile.tsv --comparefile compare.txt -resume --aligners star --fasta hg38_genome.fa --gtf gencode.v25.annotation.gtf --rRNA_fasta hg38_rRNA.fasta --outdir path/to/results --skip_createbedgraph --peakMerged_mode rank --star_index hg38/starindex --skip_meyer --skip_matk --methylation_analysis_mode Wilcox-test

See usage docs for more details and all of the available options when running the pipeline.

Documentation

The MeRIPseqPipe documentation is split into the following files:

  1. Usage
    • Parameter Documentation
    • An overview of how the pipeline works, how to run it and a description of all of the different command-line flags.
    • let us know if you need more customization!
  2. Output
    • An overview of the different results produced by the pipeline

Pipeline overview

This pipeline is built using Nextflow and integrates tools as follows:

  • Quality control and preprocessing of raw data
    • fastp: quality trimming and adapter clipping
    • FastQC: generate quality reports
    • RSeQC: assess mapping performance to give more insight into data quality
  • Read alignment
    • STAR: Spliced Transcripts Alignment to a Reference
    • HISAT2: memory efficient splice aware alignment to a reference
    • TopHat2: accurate alignment of transcriptomes in the presence of insertions, deletions and gene fusions
    • BWA: fast and accurate short read alignment with Burrows-Wheeler transform
  • Peak calling
    • MACS2: Model-based Analysis of ChIP-seq
    • MeTPeak: a novel, graphical model-based peak-calling method
    • MATK: a deep learning-based MeRIP-seq analysis tool at single-nucleotide-resolution
    • Meyer: a peak-calling tool based on Fisher's exact test
  • Peak merging
    • RobustRankAggreg: a rank aggregation algorithm
    • MSPC: using combined evidence from replicates to evaluate ChIP-seq peaks
    • BEDTools: using "mergeBed" and "intersectBed" function
  • Peak annotation
    • Perl scripts: peak start/end position, gene start/end position, transcript ID, strand, gene type (coding or noncoding, lncRNA or mRNA, etc.), peak location, gene ensemble ID, etc.
    • annotatePeaks.pl: whether a peak is in the TSS (transcription start site), TTS (transcription termination site), Exon (Coding), 5' UTR Exon, 3' UTR Exon, Intronic, or Intergenic and also shows the distance to TSS
  • Motif searching
    • HMOER: Hypergeometric Optimization of Motif EnRichment
  • M6A sites predicition
    • MATK: predict m6A sites at single nucleotide resolution
  • Differential expression analysis
    • featureCounts: read counting relative to gene biotype
    • DESeq2: for differential expression analysis of RNA-Seq, SAGE-Seq, ChIP-Seq or HiC count data
    • edgeR: for differential expression analysis of RNA-Seq, SAGE-Seq, ChIP-Seq or HiC count data
  • Differential methylation analysis
    • QNB: a statistical approach for differential RNA methylation analysis with count-based small-sample sequencing data
    • MATK: using a Bayesian hierarchical model to eliminate the effect of basal expression and quantify the true m6A level by Markov Chain Monte Carlo sampling
    • Wilcox-test: results are generated by custom R scripts referred to RPKM methods
    • DESeq2: use a generalized linear model to detect changes in IP coverage while controlling for differences in Input coverage
    • edgeR: use a generalized linear model to detect changes in IP coverage while controlling for differences in Input coverage
  • Report
    • MultiQC: summarize all results from quality control and alignment
    • R packages

Credits

MeRIPseqPipe was originally written by Xiaoqiong Bao, Kaiyu Zhu.

Contributions and Support

If you would like to contribute to this pipeline, please see the contributing guidelines.

BioTreasury

MeRIPseqPipe has been registed to BioTreasury(https://biotreasury.rjmart.cn/#/tool?id=61140), welcome to use and comment!

Citation

Xiaoqiong Bao, Kaiyu Zhu, Xuefei Liu, Zhihang Chen, Ziwei Luo, Qi Zhao, Jian Ren, Zhixiang Zuo, MeRIPseqPipe: an integrated analysis pipeline for MeRIP-seq data based on Nextflow, Bioinformatics, 2022;, btac025, https://doi.org/10.1093/bioinformatics/btac025.

Acknowledgements

Thanks to nf-core for the support and guidance!

You can cite the nf-core publication as follows:

The nf-core framework for community-curated bioinformatics pipelines.

Philip Ewels, Alexander Peltzer, Sven Fillinger, Harshil Patel, Johannes Alneberg, Andreas Wilm, Maxime Ulysse Garcia, Paolo Di Tommaso & Sven Nahnsen. Nat Biotechnol. 2020 Feb 13. doi: 10.1038/s41587-020-0439-x.

meripseqpipe's People

Contributors

canceromics avatar juneb4869 avatar likelet avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar

meripseqpipe's Issues

Remaining mentions of nf-core

Hi there,

Great work on what looks like a really nice pipeline! I notice that it looks like you used the @nf-core template to start the pipeline. This is no problem at all (we try to build our tools in such a way that people can do exactly this), but it looks like there are a few spots where you still need to strip out the default nf-core/ prefixes: https://github.com/canceromics/MeRIPseqPipe/search?q=nf-core

<title>nf-core/meripseqpipe Pipeline Report</title>

nf-core/meripseqpipe v${version}

out << "## nf-core/meripseqpipe execution completed successfully! ##"

'nf-core/meripseqpipe': ['v_pipeline.txt', r"(\S+)"],

This report has been generated by the <a href="https://github.com/nf-core/meripseqpipe" target="_blank">nf-core/meripseqpipe</a>

[![Build Status](https://travis-ci.com/nf-core/meripseqpipe.svg?branch=master)](https://travis-ci.com/nf-core/meripseqpipe)

It's always nice to have some mention of nf-core in the readme too, just to acknowledge the work that goes into the template. But it's not a requirement, at the end of the day we are happy if what we build is useful for others.

Thanks,

Phil

Can this tool be used for rip-seq analysis?

Thanks for developing such a convenient, easily reproducible process.
I want to do rip-seq analysis, but I haven't found a suitable mature pipeline. Is this pipeline suitable? If so, at what specific steps do I need to modify the parameters?

errors with meripsqpipe

Hi,

I tried to run meripsqpipe, but the job stopped running after minutes. It gave me different kinds of error everytime with same script I submitted. My script and the newest error are pasted below. Should you please give some suggestions? Many thanks!

nextflow run /sw/QFAB/miniconda3/envs/meripseqpipe-1.0dev/meripseqpipe -profile docker
--designfile /scratch/project_mnt/S0025/meripseqpipe/designfile.tsv
--comparefile /scratch/project_mnt/S0025/meripseqpipe/compare.txt
-resume --aligners star
--fasta /scratch/project_mnt/S0025/mm10/Mus_musculus.GRCm38.dna.alt.fa
--gtf /scratch/project_mnt/S0025/mm10/transcripts.gtf
--rRNA_fasta /scratch/project_mnt/S0025/meripseqpipe/rRNA.fasta
--outdir /scratch/project_mnt/S0025/meripseqpipe
--skip_createbedgraph
--peakMerged_mode rank
--star_index /scratch/project_mnt/S0025/meripseqpipe/star_mm10/
--skip_meyer --skip_matk
--methylation_analysis_mode edgeR
--expression_analysis_mode edgeR

designfile:

<style> </style>
Sample_ID input_R1 input_R2 ip_R1 ip_R2 Group_ID
Y1 Y1_Input_1.fq.gz Y1_Input_2.fq.gz Y1_IP_1.fq.gz Y1_IP_2.fq.gz Y
Y2 Y2_Input_1.fq.gz Y2_Input_2.fq.gz Y2_IP_1.fq.gz Y2_IP_2.fq.gz Y
Y3 Y3_Input_1.fq.gz Y3_Input_2.fq.gz Y3_IP_1.fq.gz Y3_IP_2.fq.gz Y
A1 A1_Input_1.fq.gz A1_Input_2.fq.gz A1_IP_1.fq.gz A1_IP_2.fq.gz A
A2 A2_Input_1.fq.gz A2_Input_2.fq.gz A2_IP_1.fq.gz A2_IP_2.fq.gz A
A3 A3_Input_1.fq.gz A3_Input_2.fq.gz A3_IP_1.fq.gz A3_IP_2.fq.gz A

compare file:
Y_vs_A

.nextflow.log:
May-16 14:11:08.711 [main] DEBUG nextflow.cli.Launcher - $> nextflow run /sw/QFAB/miniconda3/envs/meripseqpipe-1.0dev/meripseqpipe -profile docker --designfile /scratch/project_mnt/S0025/meripseqpipe/designfile.tsv --comparefile /scratch/project_mnt/S0025/meripseqpipe/compare.txt -resume --aligners star --fasta /scratch/project_mnt/S0025/mm10/Mus_musculus.GRCm38.dna.alt.fa --gtf /scratch/project_mnt/S0025/mm10/transcripts.gtf --rRNA_fasta /scratch/project_mnt/S0025/meripseqpipe/rRNA.fasta --outdir /scratch/project_mnt/S0025/meripseqpipe --skip_createbedgraph --peakMerged_mode rank --star_index /scratch/project_mnt/S0025/meripseqpipe/star_mm10/ --skip_meyer --skip_matk --methylation_analysis_mode edgeR --expression_analysis_mode edgeR
May-16 14:11:08.772 [main] INFO nextflow.cli.CmdRun - N E X T F L O W ~ version 21.10.6
May-16 14:11:09.757 [main] INFO nextflow.cli.CmdRun - Launching /sw/QFAB/miniconda3/envs/meripseqpipe-1.0dev/meripseqpipe/main.nf [hopeful_watson] - revision: e1edd95b50
May-16 14:11:09.769 [main] DEBUG nextflow.config.ConfigBuilder - Found config base: /sw/QFAB/miniconda3/envs/meripseqpipe-1.0dev/meripseqpipe/nextflow.config
May-16 14:11:09.770 [main] DEBUG nextflow.config.ConfigBuilder - Parsing config file: /sw/QFAB/miniconda3/envs/meripseqpipe-1.0dev/meripseqpipe/nextflow.config
May-16 14:11:09.779 [main] DEBUG nextflow.config.ConfigBuilder - Applying config profile: docker
May-16 14:11:10.278 [main] DEBUG nextflow.config.ConfigBuilder - Available config profiles: [test_mixed, debug, test, conda, test_bam, none, docker, C2]
May-16 14:11:10.286 [main] WARN nextflow.config.ConfigBuilder - It appears you have never run this project before -- Option -resume is ignored
May-16 14:11:10.326 [main] DEBUG nextflow.plugin.PluginsFacade - Setting up plugin manager > mode=prod; plugins-dir=/home/s4442589/.nextflow/plugins
May-16 14:11:10.328 [main] DEBUG nextflow.plugin.PluginsFacade - Plugins default=[]
May-16 14:11:10.339 [main] INFO org.pf4j.DefaultPluginStatusProvider - Enabled plugins: []
May-16 14:11:10.340 [main] INFO org.pf4j.DefaultPluginStatusProvider - Disabled plugins: []
May-16 14:11:10.344 [main] INFO org.pf4j.DefaultPluginManager - PF4J version 3.4.1 in 'deployment' mode
May-16 14:11:10.354 [main] INFO org.pf4j.AbstractPluginManager - No plugins
May-16 14:11:10.403 [main] DEBUG nextflow.Session - Session uuid: 64a4cfa1-1990-48fd-904c-12472eadd53c
May-16 14:11:10.403 [main] DEBUG nextflow.Session - Run name: hopeful_watson
May-16 14:11:10.404 [main] DEBUG nextflow.Session - Executor pool size: 48
May-16 14:11:10.450 [main] DEBUG nextflow.cli.CmdRun -
Version: 21.10.6 build 5660
Created: 21-12-2021 16:55 UTC (22-12-2021 02:55 AEDT)
System: Linux 3.10.0-693.5.2.el7.x86_64
Runtime: Groovy 3.0.9 on Java HotSpot(TM) 64-Bit Server VM 11.0.7+8-LTS
Encoding: UTF-8 (UTF-8)
Process: [email protected] [10.120.20.61]
CPUs: 48 - Mem: 125.6 GB (102.5 GB) - Swap: 1000 MB (936.1 MB)
May-16 14:11:10.505 [main] DEBUG nextflow.Session - Work-dir: /scratch/project_mnt/S0025/meripseqpipe/work [gpfs]
May-16 14:11:10.542 [main] DEBUG nextflow.executor.ExecutorFactory - Extension executors providers=[]
May-16 14:11:10.555 [main] DEBUG nextflow.Session - Observer factory: DefaultObserverFactory
May-16 14:11:10.634 [main] DEBUG nextflow.util.CustomThreadPool - Creating default thread pool > poolSize: 49; maxThreads: 1000
May-16 14:11:10.818 [main] DEBUG nextflow.Session - Session start invoked
May-16 14:11:10.823 [main] DEBUG nextflow.trace.TraceFileObserver - Flow starting -- trace file: /scratch/project_mnt/S0025/meripseqpipe/pipeline_info/execution_trace.txt
May-16 14:11:10.838 [main] DEBUG nextflow.Session - Using default localLib path: /sw/QFAB/miniconda3/envs/meripseqpipe-1.0dev/meripseqpipe/lib
May-16 14:11:10.842 [main] DEBUG nextflow.Session - Adding to the classpath library: /sw/QFAB/miniconda3/envs/meripseqpipe-1.0dev/meripseqpipe/lib
May-16 14:11:13.856 [main] DEBUG nextflow.script.ScriptRunner - > Launching execution
May-16 14:11:13.967 [main] DEBUG nextflow.util.CustomThreadPool - Creating default thread pool > poolSize: 49; maxThreads: 1000
May-16 14:11:14.054 [main] INFO nextflow.script.BaseScript - null
May-16 14:11:14.055 [main] INFO nextflow.script.BaseScript - �[35m============You are running m6APipe with the following parameters===============�[0m
May-16 14:11:14.055 [main] INFO nextflow.script.BaseScript - �[35mChecking parameters ...�[0m
May-16 14:11:14.055 [main] INFO nextflow.script.BaseScript - �[33m===================================Pipeline summary=============================�[0m
May-16 14:11:14.057 [main] INFO nextflow.script.BaseScript - �[33mMax Resources : �[0m�[32m100 GB memory, 20 cpus, 10d time per job�[0m
May-16 14:11:14.057 [main] INFO nextflow.script.BaseScript - �[33mContainer : �[0m�[32mdocker - kingzhuky/meripseqpipe:dev�[0m
May-16 14:11:14.057 [main] INFO nextflow.script.BaseScript - �[33mOutput dir : �[0m�[32m/scratch/project_mnt/S0025/meripseqpipe�[0m
May-16 14:11:14.058 [main] INFO nextflow.script.BaseScript - �[33mLaunch dir : �[0m�[32m/scratch/project_mnt/S0025/meripseqpipe�[0m
May-16 14:11:14.058 [main] INFO nextflow.script.BaseScript - �[33mWorking dir : �[0m�[32m/scratch/project_mnt/S0025/meripseqpipe/work�[0m
May-16 14:11:14.058 [main] INFO nextflow.script.BaseScript - �[33mScript dir : �[0m�[32m/sw/QFAB/miniconda3/envs/meripseqpipe-1.0dev/meripseqpipe�[0m
May-16 14:11:14.059 [main] INFO nextflow.script.BaseScript - �[33mUser : �[0m�[32ms4442589�[0m
May-16 14:11:14.059 [main] INFO nextflow.script.BaseScript - �[33mConfig Profile : �[0m�[32mdocker�[0m
May-16 14:11:14.059 [main] INFO nextflow.script.BaseScript - �[33m=====================================Reads types================================�[0m
May-16 14:11:14.059 [main] INFO nextflow.script.BaseScript - �[33mSingleEnd : �[0m�[32mPaired-End�[0m
May-16 14:11:14.060 [main] INFO nextflow.script.BaseScript - �[33mStranded : �[0m�[32mno�[0m
May-16 14:11:14.061 [main] INFO nextflow.script.BaseScript - �[33mgzip : �[0m�[32mfalse�[0m
May-16 14:11:14.061 [main] INFO nextflow.script.BaseScript - �[33m====================================Mode selected==============================�[0m
May-16 14:11:14.061 [main] INFO nextflow.script.BaseScript - �[33maligners : �[0m�[32mstar�[0m
May-16 14:11:14.061 [main] INFO nextflow.script.BaseScript - �[33mpeakCalling_mode : �[0m�[32mindependence�[0m
May-16 14:11:14.061 [main] INFO nextflow.script.BaseScript - �[33mpeakMerged_mode : �[0m�[32mrank�[0m
May-16 14:11:14.062 [main] INFO nextflow.script.BaseScript - �[33mexpression_analysis_mode : �[0m�[32medgeR�[0m
May-16 14:11:14.062 [main] INFO nextflow.script.BaseScript - �[33mmethylation_analysis_mode : �[0m�[32medgeR�[0m
May-16 14:11:14.062 [main] INFO nextflow.script.BaseScript - �[33m==================================Input files selected==========================�[0m
May-16 14:11:14.063 [main] INFO nextflow.script.BaseScript - �[33mReads Path : �[0m�[32mfalse�[0m
May-16 14:11:14.063 [main] INFO nextflow.script.BaseScript - �[33mfasta file : �[0m�[32m/scratch/project_mnt/S0025/mm10/Mus_musculus.GRCm38.dna.alt.fa�[0m
May-16 14:11:14.063 [main] INFO nextflow.script.BaseScript - �[33mGtf file : �[0m�[32m/scratch/project_mnt/S0025/mm10/transcripts.gtf�[0m
May-16 14:11:14.063 [main] INFO nextflow.script.BaseScript - �[33mDesign file : �[0m�[32m/scratch/project_mnt/S0025/meripseqpipe/designfile.tsv�[0m
May-16 14:11:14.063 [main] INFO nextflow.script.BaseScript - �[33mCompare file : �[0m�[32m/scratch/project_mnt/S0025/meripseqpipe/compare.txt�[0m
May-16 14:11:14.063 [main] INFO nextflow.script.BaseScript - �[33m==================================Skip model selected==========================�[0m
May-16 14:11:14.064 [main] INFO nextflow.script.BaseScript - �[33mSkip samtools sort : �[0m�[32mfalse�[0m
May-16 14:11:14.064 [main] INFO nextflow.script.BaseScript - �[33mSkip expression analysis : �[0m�[32mfalse�[0m
May-16 14:11:14.064 [main] INFO nextflow.script.BaseScript - �[33mSkip peakCalling : �[0m�[32mfalse�[0m
May-16 14:11:14.064 [main] INFO nextflow.script.BaseScript - �[33mSkip diffpeakCalling : �[0m�[32mfalse�[0m
May-16 14:11:14.064 [main] INFO nextflow.script.BaseScript - �[33mSkip annotation : �[0m�[32mfalse�[0m
May-16 14:11:14.064 [main] INFO nextflow.script.BaseScript - �[33mSkip qc : �[0m�[32mfalse�[0m
May-16 14:11:14.124 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.124 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.129 [main] DEBUG nextflow.executor.Executor - [warm up] executor > local
May-16 14:11:14.136 [main] DEBUG n.processor.LocalPollingMonitor - Creating local task monitor for executor 'local' > cpus=20; memory=100 GB; capacity=200; pollInterval=30s; dumpInterval=5m
May-16 14:11:14.217 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:build_index matches labels build_index for process with name makeBED12
May-16 14:11:14.244 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.245 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.252 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:build_index matches labels build_index for process with name makechromesize
May-16 14:11:14.254 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.254 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.263 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:build_index matches labels build_index for process with name MakeTophat2Index
May-16 14:11:14.263 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.263 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.270 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:build_index matches labels build_index for process with name MakeHisat2Index
May-16 14:11:14.270 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.271 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.279 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:build_index matches labels build_index for process with name MakeBWAIndex
May-16 14:11:14.281 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.281 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.302 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:build_index matches labels build_index for process with name MakerRNAindex
May-16 14:11:14.303 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.303 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.326 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.326 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.345 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.346 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.356 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:aligners matches labels aligners for process with name FilterrRNA
May-16 14:11:14.357 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.357 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.373 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:aligners matches labels aligners for process with name Tophat2Align
May-16 14:11:14.374 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.374 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.383 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:aligners matches labels aligners for process with name Hisat2Align
May-16 14:11:14.383 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.383 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.393 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:aligners matches labels aligners for process with name BWAAlign
May-16 14:11:14.394 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.394 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.402 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:aligners matches labels aligners for process with name StarAlign
May-16 14:11:14.403 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.403 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.414 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.414 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.425 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.426 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.426 [Task submitter] DEBUG nextflow.executor.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
May-16 14:11:14.436 [Task submitter] INFO nextflow.Session - [83/84c3f7] Submitted process > MakerRNAindex (rRNA_index)
May-16 14:11:14.443 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.443 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.451 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.451 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.458 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.458 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.471 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:onecore_peak matches labels onecore_peak for process with name Metpeak
May-16 14:11:14.472 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.472 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.476 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:onecore_peak matches labels onecore_peak for process with name Macs2
May-16 14:11:14.477 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.477 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.481 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:onecore_peak matches labels onecore_peak for process with name MATKpeakCalling
May-16 14:11:14.481 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.481 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.486 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:build_index matches labels build_index for process with name MeyerPrepration
May-16 14:11:14.487 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.487 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.492 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:peak_calling matches labels peak_calling for process with name Meyer
May-16 14:11:14.492 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.492 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.495 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 7; name: MakerRNAindex (rRNA_index); status: COMPLETED; exit: 127; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/83/84c3f7642dc1ba32be6a19159521e1]
May-16 14:11:14.497 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:analysis matches labels analysis for process with name FeatureCount
May-16 14:11:14.497 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.497 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.501 [Task submitter] DEBUG nextflow.executor.LocalTaskHandler - Launch cmd line: /bin/bash -ue .command.run
May-16 14:11:14.502 [Task submitter] INFO nextflow.Session - [61/38b2ca] Submitted process > CheckDesignCompare
May-16 14:11:14.502 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:analysis matches labels analysis for process with name DESeq2
May-16 14:11:14.503 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.503 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.508 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:analysis matches labels analysis for process with name EdgeR
May-16 14:11:14.508 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.508 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.512 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:analysis matches labels analysis for process with name Cufflinks
May-16 14:11:14.513 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.513 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.514 [Task monitor] ERROR nextflow.processor.TaskProcessor - Error executing process > 'MakerRNAindex (rRNA_index)'

Caused by:
Process MakerRNAindex (rRNA_index) terminated with an error exit status (127)

Command executed:

mkdir rRNAindex
hisat2-build -p 20 -f rRNA.fasta rRNAindex/rRNA

Command exit status:
127

Command output:
(empty)

Command error:
.command.run: line 279: docker: command not found

Work dir:
/scratch/project_mnt/S0025/meripseqpipe/work/83/84c3f7642dc1ba32be6a19159521e1

Tip: when you have fixed the problem you can continue the execution adding the option -resume to the run command line
May-16 14:11:14.520 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:analysis matches labels analysis for process with name PeakMerge
May-16 14:11:14.521 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.521 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.535 [Task monitor] INFO nextflow.Session - Execution cancelled -- Finishing pending tasks before exit
May-16 14:11:14.569 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:onecore_peak matches labels onecore_peak for process with name BedAnnotated
May-16 14:11:14.569 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.569 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.576 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:onecore_peak matches labels onecore_peak for process with name MotifSearching
May-16 14:11:14.577 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.577 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.582 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.582 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.593 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:analysis matches labels analysis for process with name PeaksQuantification
May-16 14:11:14.593 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.593 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.600 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:analysis matches labels analysis for process with name diffm6APeak
May-16 14:11:14.601 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.601 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.607 [main] DEBUG nextflow.script.ProcessConfig - Config settings withLabel:analysis matches labels analysis for process with name SingleNucleotidePrediction
May-16 14:11:14.608 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.608 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.616 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.616 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.622 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.622 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.626 [main] DEBUG nextflow.executor.ExecutorFactory - << taskConfig executor: local
May-16 14:11:14.626 [main] DEBUG nextflow.executor.ExecutorFactory - >> processorType: 'local'
May-16 14:11:14.630 [main] DEBUG nextflow.Session - Workflow process names [dsl1]: PeakMerge, DiffReport, Meyer, MakeBWAIndex, GenebodyCoverage, makechromesize, FeatureCount, diffm6APeak, CheckDesignCompare, MakeStarIndex, Fastqc, MeyerPrepration, MakeHisat2Index, CreateIGVjs, SortRename, Cufflinks, QCPeaksReport, Tophat2Align, get_software_versions, multiqc, makeBED12, MATKpeakCalling, BWAAlign, Macs2, FilterrRNA, DESeq2, Metpeak, MakeTophat2Index, EdgeR, MotifSearching, StarAlign, Hisat2Align, BedAnnotated, SingleNucleotidePrediction, CreateBedgraph, Fastp, RSeQC, PeaksQuantification, MakerRNAindex
May-16 14:11:14.645 [main] WARN nextflow.Session - There's no process matching config selector: fastp -- Did you mean: Fastp?
May-16 14:11:14.646 [main] WARN nextflow.Session - There's no process matching config selector: sort
May-16 14:11:14.647 [main] DEBUG nextflow.script.ScriptRunner - > Await termination
May-16 14:11:14.647 [main] DEBUG nextflow.Session - Session await
May-16 14:11:14.647 [main] DEBUG nextflow.Session - Session await > all process finished
May-16 14:11:44.489 [Task monitor] DEBUG n.processor.TaskPollingMonitor - Task completed > TaskHandler[id: 1; name: CheckDesignCompare; status: COMPLETED; exit: 127; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/61/38b2ca9e75829b98ae54bc9190a7f9]
May-16 14:11:44.491 [main] DEBUG nextflow.Session - Session await > all barriers passed
May-16 14:16:14.522 [Task submitter] DEBUG n.processor.TaskPollingMonitor - %% executor local > tasks in the submission queue: 15 -- tasks to be submitted are shown below
~> TaskHandler[id: 3; name: makechromesize (gtf2bed12); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/80/d5a460a9f48680a368cb5f9ed509a9]
~> TaskHandler[id: 2; name: makeBED12 (gtf2bed12); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/7e/8592632efd6ca798b89c023432d5b1]
~> TaskHandler[id: 15; name: Fastp (Y2_IP); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/70/6de01d35d58e4f2457d629d9fb52a8]
~> TaskHandler[id: 19; name: Fastp (A3_IP); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/50/55073741dece6573d473330c22f79e]
~> TaskHandler[id: 10; name: Fastp (Y3_Input); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/ff/70c294726c8cb737b351494f10fda3]
~> TaskHandler[id: 18; name: Fastp (A2_IP); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/98/2356b3267742571337bba1bfe0b92d]
~> TaskHandler[id: 16; name: Fastp (A1_IP); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/9c/f1e02ea704b7b1043654d06d43dc22]
~> TaskHandler[id: 11; name: Fastp (A1_Input); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/55/f58a4b1de2cc8e5a8ab2c5548e3ab1]
~> TaskHandler[id: 17; name: Fastp (Y3_IP); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/e7/16df1030ad5c89fd557daa3ad74950]
~> TaskHandler[id: 13; name: Fastp (A3_Input); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/8a/34c65a5f6480dc2f3e262eb51e4e6d]
.. remaining tasks omitted.
May-16 14:21:14.555 [Task submitter] DEBUG n.processor.TaskPollingMonitor - %% executor local > tasks in the submission queue: 15 -- tasks to be submitted are shown below
~> TaskHandler[id: 3; name: makechromesize (gtf2bed12); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/80/d5a460a9f48680a368cb5f9ed509a9]
~> TaskHandler[id: 2; name: makeBED12 (gtf2bed12); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/7e/8592632efd6ca798b89c023432d5b1]
~> TaskHandler[id: 15; name: Fastp (Y2_IP); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/70/6de01d35d58e4f2457d629d9fb52a8]
~> TaskHandler[id: 19; name: Fastp (A3_IP); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/50/55073741dece6573d473330c22f79e]
~> TaskHandler[id: 10; name: Fastp (Y3_Input); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/ff/70c294726c8cb737b351494f10fda3]
~> TaskHandler[id: 18; name: Fastp (A2_IP); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/98/2356b3267742571337bba1bfe0b92d]
~> TaskHandler[id: 16; name: Fastp (A1_IP); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/9c/f1e02ea704b7b1043654d06d43dc22]
~> TaskHandler[id: 11; name: Fastp (A1_Input); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/55/f58a4b1de2cc8e5a8ab2c5548e3ab1]
~> TaskHandler[id: 17; name: Fastp (Y3_IP); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/e7/16df1030ad5c89fd557daa3ad74950]
~> TaskHandler[id: 13; name: Fastp (A3_Input); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/8a/34c65a5f6480dc2f3e262eb51e4e6d]
.. remaining tasks omitted.
May-16 14:26:14.587 [Task submitter] DEBUG n.processor.TaskPollingMonitor - %% executor local > tasks in the submission queue: 15 -- tasks to be submitted are shown below
~> TaskHandler[id: 3; name: makechromesize (gtf2bed12); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/80/d5a460a9f48680a368cb5f9ed509a9]
~> TaskHandler[id: 2; name: makeBED12 (gtf2bed12); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/7e/8592632efd6ca798b89c023432d5b1]
~> TaskHandler[id: 15; name: Fastp (Y2_IP); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/70/6de01d35d58e4f2457d629d9fb52a8]
~> TaskHandler[id: 19; name: Fastp (A3_IP); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/50/55073741dece6573d473330c22f79e]
~> TaskHandler[id: 10; name: Fastp (Y3_Input); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/ff/70c294726c8cb737b351494f10fda3]
~> TaskHandler[id: 18; name: Fastp (A2_IP); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/98/2356b3267742571337bba1bfe0b92d]
~> TaskHandler[id: 16; name: Fastp (A1_IP); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/9c/f1e02ea704b7b1043654d06d43dc22]
~> TaskHandler[id: 11; name: Fastp (A1_Input); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/55/f58a4b1de2cc8e5a8ab2c5548e3ab1]
~> TaskHandler[id: 17; name: Fastp (Y3_IP); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/e7/16df1030ad5c89fd557daa3ad74950]
~> TaskHandler[id: 13; name: Fastp (A3_Input); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/8a/34c65a5f6480dc2f3e262eb51e4e6d]
.. remaining tasks omitted.
May-16 14:31:14.617 [Task submitter] DEBUG n.processor.TaskPollingMonitor - %% executor local > tasks in the submission queue: 15 -- tasks to be submitted are shown below
~> TaskHandler[id: 3; name: makechromesize (gtf2bed12); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/80/d5a460a9f48680a368cb5f9ed509a9]
~> TaskHandler[id: 2; name: makeBED12 (gtf2bed12); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/7e/8592632efd6ca798b89c023432d5b1]
~> TaskHandler[id: 15; name: Fastp (Y2_IP); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/70/6de01d35d58e4f2457d629d9fb52a8]
~> TaskHandler[id: 19; name: Fastp (A3_IP); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/50/55073741dece6573d473330c22f79e]
~> TaskHandler[id: 10; name: Fastp (Y3_Input); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/ff/70c294726c8cb737b351494f10fda3]
~> TaskHandler[id: 18; name: Fastp (A2_IP); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/98/2356b3267742571337bba1bfe0b92d]
~> TaskHandler[id: 16; name: Fastp (A1_IP); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/9c/f1e02ea704b7b1043654d06d43dc22]
~> TaskHandler[id: 11; name: Fastp (A1_Input); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/55/f58a4b1de2cc8e5a8ab2c5548e3ab1]
~> TaskHandler[id: 17; name: Fastp (Y3_IP); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/e7/16df1030ad5c89fd557daa3ad74950]
~> TaskHandler[id: 13; name: Fastp (A3_Input); status: NEW; exit: -; error: -; workDir: /scratch/project_mnt/S0025/meripseqpipe/work/8a/34c65a5f6480dc2f3e262eb51e4e6d]
.. remaining tasks omitted.

running with singularity

I try to running this pipe on hpc cluster with singularity, and I find some config error .

I add these config in nextflow.config .
singularity { singularity.enabled = true singularity.runOptions = "-B /GPFS:/GPFS" params.matk_jar = "/MATK-1.0.jar" }

-B /GPFS:/GPFS for mount out file system,
params.matk_jar for img to find matk jar package

if not add these, I can't pass the pipe test.

Error executing process > 'makeBED12 (gtf2bed12)'

The test run of Nextflow worked well. But something goes wrong when using my own data.

I have two pairs of input and two pairs of ip. The sample is Arabidopsis thaliana. Following is my command and the pop-ups in Ubuntu:

sudo NXF_VER=22.10.7 nextflow run . -profile docker --designfile mr231028/mr231028_designfile_paired.tsv --comparefile mr231028/mr231028_comparefile.txt --fasta ref/TAIR10_chr_all.fasta --gtf ref/Araport11_GTF_genes_transposons.Oct2023.gtf --outdir results_mr231028/


Nextflow 23.10.0 is available - Please consider updating your version to it
N E X T F L O W  ~  version 22.10.7
Launching `./main.nf` [silly_galileo] DSL1 - revision: 35281af540
 ▄▄▄▄▄▄▄▄▄▄▄  ▄         ▄  ▄▄▄▄▄▄▄▄▄▄▄  ▄         ▄  ▄▄▄▄▄▄▄▄▄▄▄  ▄▄▄▄▄▄▄▄▄▄▄
▐░░░░░░░░░░░▌▐░▌       ▐░▌▐░░░░░░░░░░░▌▐░▌       ▐░▌▐░░░░░░░░░░░▌▐░░░░░░░░░░░▌
▐░█▀▀▀▀▀▀▀▀▀ ▐░▌       ▐░▌▐░█▀▀▀▀▀▀▀▀▀ ▐░▌       ▐░▌▐░█▀▀▀▀▀▀▀▀▀ ▐░█▀▀▀▀▀▀▀▀▀
▐░▌          ▐░▌       ▐░▌▐░▌          ▐░▌       ▐░▌▐░▌          ▐░▌
▐░█▄▄▄▄▄▄▄▄▄ ▐░█▄▄▄▄▄▄▄█░▌▐░█▄▄▄▄▄▄▄▄▄ ▐░▌       ▐░▌▐░▌          ▐░▌
▐░░░░░░░░░░░▌▐░░░░░░░░░░░▌▐░░░░░░░░░░░▌▐░▌       ▐░▌▐░▌          ▐░▌
 ▀▀▀▀▀▀▀▀▀█░▌ ▀▀▀▀█░█▀▀▀▀  ▀▀▀▀▀▀▀▀▀█░▌▐░▌       ▐░▌▐░▌          ▐░▌
          ▐░▌     ▐░▌               ▐░▌▐░▌       ▐░▌▐░▌          ▐░▌
 ▄▄▄▄▄▄▄▄▄█░▌     ▐░▌      ▄▄▄▄▄▄▄▄▄█░▌▐░█▄▄▄▄▄▄▄█░▌▐░█▄▄▄▄▄▄▄▄▄ ▐░█▄▄▄▄▄▄▄▄▄
▐░░░░░░░░░░░▌     ▐░▌     ▐░░░░░░░░░░░▌▐░░░░░░░░░░░▌▐░░░░░░░░░░░▌▐░░░░░░░░░░░▌
 ▀▀▀▀▀▀▀▀▀▀▀       ▀       ▀▀▀▀▀▀▀▀▀▀▀  ▀▀▀▀▀▀▀▀▀▀▀  ▀▀▀▀▀▀▀▀▀▀▀  ▀▀▀▀▀▀▀▀▀▀▀
null
============You are running MeRIPseqPipe with the following parameters===============
Checking parameters ...
===================================Pipeline summary=============================
Max Resources                  : 100 GB memory, 20 cpus, 10d time per job
Container                       : docker - kingzhuky/meripseqpipe:dev
Output dir                     : results_mr231028/
Launch dir                     : /home/wuqy/bin/MeRIPseqPipe
Working dir                    : /home/wuqy/bin/MeRIPseqPipe/work
Script dir                     : /home/wuqy/bin/MeRIPseqPipe
User                           : root
Config Profile                 : docker
=====================================Reads types================================
SingleEnd                      : Paired-End
Stranded                       : no
gzip                           : true
====================================Mode selected==============================
aligners                       : star
peakCalling_mode               : independence
peakMerged_mode                : rank
expression_analysis_mode       : DESeq2
methylation_analysis_mode      : QNB
==================================Input files selected==========================
Reads Path                     : false
fasta file                     : ref/TAIR10_chr_all.fasta
Gtf file                       : ref/Araport11_GTF_genes_transposons.Oct2023.gtf
Design file                    : mr231028/mr231028_designfile_paired.tsv
Compare file                   : mr231028/mr231028_comparefile.txt
==================================Skip model selected==========================
Skip samtools sort             : false
Skip expression analysis       : false
Skip peakCalling               : false
Skip diffpeakCalling           : false
Skip annotation                : false
Skip qc                        : false
executor >  local (4)
[e4/d87b9a] process > CheckDesignCompare         [100%] 1 of 1 ✔
[20/62b06d] process > makeBED12 (gtf2bed12)      [  0%] 0 of 1
[e6/20c208] process > makechromesize (gtf2bed12) [  0%] 0 of 1
[-        ] process > MakeTophat2Index           -
[-        ] process > MakeHisat2Index            -
[-        ] process > MakeBWAIndex               -
executor >  local (4)
[e4/d87b9a] process > CheckDesignCompare         [100%] 1 of 1 ✔
[20/62b06d] process > makeBED12 (gtf2bed12)      [100%] 1 of 1, failed: 1 ✘
[e6/20c208] process > makechromesize (gtf2bed12) [  0%] 0 of 1
[-        ] process > MakeTophat2Index           -
[-        ] process > MakeHisat2Index            -
[-        ] process > MakeBWAIndex               -
[68/681c8a] process > MakeStarIndex (star_index) [100%] 1 of 1 ✔
executor >  local (4)
[e4/d87b9a] process > CheckDesignCompare         [100%] 1 of 1 ✔
[20/62b06d] process > makeBED12 (gtf2bed12)      [100%] 1 of 1, failed: 1 ✘
[e6/20c208] process > makechromesize (gtf2bed12) [100%] 1 of 1 ✔
[-        ] process > MakeTophat2Index           -
[-        ] process > MakeHisat2Index            -
[-        ] process > MakeBWAIndex               -
[68/681c8a] process > MakeStarIndex (star_index) [100%] 1 of 1 ✔
[-        ] process > MakerRNAindex              -
One more CTRL+C to force exit                    [  0%] 0 of 4
executor >  local (4)
[e4/d87b9a] process > CheckDesignCompare         [100%] 1 of 1 ✔
[20/62b06d] process > makeBED12 (gtf2bed12)      [100%] 1 of 1, failed: 1 ✘
[e6/20c208] process > makechromesize (gtf2bed12) [100%] 1 of 1 ✔
[-        ] process > MakeTophat2Index           -
[-        ] process > MakeHisat2Index            -
[-        ] process > MakeBWAIndex               -
[68/681c8a] process > MakeStarIndex (star_index) [100%] 1 of 1 ✔
[-        ] process > MakerRNAindex              -
[-        ] process > Fastp                      [  0%] 0 of 4
[-        ] process > Fastqc                     -
[-        ] process > Tophat2Align               -
[-        ] process > Hisat2Align                -
[-        ] process > BWAAlign                   -
[-        ] process > StarAlign                  -
[-        ] process > SortRename                 -
[-        ] process > RSeQC                      -
[-        ] process > CreateBedgraph             -
[-        ] process > multiqc                    -
[-        ] process > FeatureCount               -
[-        ] process > DESeq2                     -
[-        ] process > EdgeR                      -
[-        ] process > Metpeak                    -
[-        ] process > Macs2                      -
[-        ] process > MATKpeakCalling            -
[-        ] process > MeyerPrepration            -
[-        ] process > Meyer                      -
[-        ] process > PeakMerge                  -
[-        ] process > BedAnnotated               -
[-        ] process > MotifSearching             -
[-        ] process > PeaksMotifReport           -
[-        ] process > PeaksQuantification        -
[-        ] process > diffm6APeak                -
[-        ] process > SingleNucleotidePrediction -
[-        ] process > DiffReport                 -
[-        ] process > CreateIGVjs                -
[-        ] process > get_software_versions      [  0%] 0 of 1

Error executing process > 'makeBED12 (gtf2bed12)'

Caused by:
  Process `makeBED12 (gtf2bed12)` terminated with an error exit status (255)

Command executed:

  gtf_file=Araport11_GTF_genes_transposons.Oct2023.gtf
  gtfToGenePred -genePredExt -geneNameAsName2 $gtf_file ${gtf_file/.gtf/.tmp}
  genePredToBed ${gtf_file/.gtf/.tmp} ${gtf_file/.gtf/.bed}

Command exit status:
  255

Command output:
  (empty)

Command error:
  no exons defined for group AT1G01010, feature gene (perhaps try -ignoreGroupsWithoutExons)

Work dir:
  /home/wuqy/bin/MeRIPseqPipe/work/20/62b06de331ba54b9654d8afede57d9

Tip: you can replicate the issue by changing to the process work dir and entering the command `bash .command.run`


I downloaded the gtf and chromosome fasta from TAIR official site. It seems like something going wrong with gene definition starting from the first gene.

It mentioned to try -ignoreGroupsWithoutExons, but im not sure where to put this parameter since it does not show in the parameter docs. And it seems not working in the initial command line.

It would be thankful if anyone can fix this.

============================================================

The problem is fixed by editing the .gtf file of Arabidopsis thaliana. I think there will be no error for other species gtf file. The miRNA without exons in the gtf file may also causes this issue, just simply added -ignoreGroupsWithoutExons at line 382 of main.nf.

/bin/bash: .command.run: No such file or directory

I have downloaded the installation package and singularity (export NXF_SINGULARITY_CACHEDIR=/home/zhangli_lab/wangyanmin/scratch60/meripseqpipe/2) image separately, the path is /home/zhangli_lab/wangyanmin/scratch60/meripseqpipe/2 Software: nextflow, singularity has been installed , testing nextflow run path/to/meripseqpipe -profile test,singularity has a problem, I don't know if it is my running problem or the configuration file needs to be modified, I hope I can get help, thank you very much

Here is my run command and output error:
[wangyanmin@login01 2]$ nextflow MeRIPseqPipe/main.nf -c MeRIPseqPipe/nextflow.config -profile test,singularity
N E X T F L O W ~ version 21.04.0
Launching MeRIPseqPipe/main.nf [magical_babbage] - revision: 992c8903be
WARN: There's no process matching config selector: fastp -- Did you mean: Fastp?
WARN: There's no process matching config selector: sort
============You are running MeRIPseqPipe with the following parameters===============
Checking parameters ...
===================================Pipeline summary=============================
Max Resources : 6 GB memory, 2 cpus, 2d time per job
Container : singularity - kingzhuky/meripseqpipe:dev
Output dir : /GPFS/zhangli_lab_temp/wangyanmin/meripseqpipe/2/MeRIPseqPipe/results
Launch dir : /GPFS/zhangli_lab_temp/wangyanmin/meripseqpipe/2
Working dir : /GPFS/zhangli_lab_temp/wangyanmin/meripseqpipe/2/work
Script dir : /GPFS/zhangli_lab_temp/wangyanmin/meripseqpipe/2/MeRIPseqPipe
User : wangyanmin
Config Profile : test,singularity
Config Description : Minimal test dataset to check pipeline function
=====================================Reads types================================
SingleEnd : Single-End
Stranded : no
gzip : true
====================================Mode selected==============================
aligners : star
peakCalling_mode : independence
peakMerged_mode : rank
expression_analysis_mode : DESeq2
methylation_analysis_mode : QNB
==================================Input files selected==========================
Reads Path : false
fasta file : /GPFS/zhangli_lab_temp/wangyanmin/meripseqpipe/2/MeRIPseqPipe/test_datasets/reference/TEST.fa
Gtf file : /GPFS/zhangli_lab_temp/wangyanmin/meripseqpipe/2/MeRIPseqPipe/test_datasets/reference/TEST.gtf
Design file : /GPFS/zhangli_lab_temp/wangyanmin/meripseqpipe/2/MeRIPseqPipe/test_datasets/inputfiles/designfile_single.tsv
Compare file : /GPFS/zhangli_lab_temp/wangyanmin/meripseqpipe/2/MeRIPseqPipe/test_datasets/inputfiles/comparefile.txt
==================================Skip model selected==========================
Skip samtools sort : false
Skip expression analysis : false
Skip peakCalling : false
Skip diffpeakCalling : false
Skip annotation : false
Skip qc : false
executor > local (10)
[b1/660778] process > CheckDesignCompare [ 0%] 0 of 1
[01/6779e5] process > makeBED12 (gtf2bed12) [ 0%] 0 of 1
[bc/441837] process > makechromesize (gtf2bed12) [ 0%] 0 of 1
[- ] process > MakeTophat2Index -
[- ] process > MakeHisat2Index -
[- ] process > MakeBWAIndex -
[a0/dd4b7e] process > MakeStarIndex (star_index) [ 0%] 0 of 1
[- ] process > MakerRNAindex -
[cb/25c8fb] process > Fastp (control_1.input) [ 0%] 0 of 8
executor > local (10)
[b1/660778] process > CheckDesignCompare [ 0%] 0 of 1
[01/6779e5] process > makeBED12 (gtf2bed12) [ 0%] 0 of 1
[bc/441837] process > makechromesize (gtf2bed12) [ 0%] 0 of 1
[- ] process > MakeTophat2Index -
[- ] process > MakeHisat2Index -
[- ] process > MakeBWAIndex -
[a0/dd4b7e] process > MakeStarIndex (star_index) [ 0%] 0 of 1
[- ] process > MakerRNAindex -
[cb/25c8fb] process > Fastp (control_1.input) [ 0%] 0 of 8
executor > local (11)
[b1/660778] process > CheckDesignCompare [ 0%] 0 of 1
[01/6779e5] process > makeBED12 (gtf2bed12) [ 0%] 0 of 1
[bc/441837] process > makechromesize (gtf2bed12) [ 0%] 0 of 1
[- ] process > MakeTophat2Index -
[- ] process > MakeHisat2Index -
[- ] process > MakeBWAIndex -
[a0/dd4b7e] process > MakeStarIndex (star_index) [ 0%] 0 of 1
[- ] process > MakerRNAindex -
[69/b5fa1d] process > Fastp (control_1.ip) [ 0%] 0 of 8
[- ] process > Fastqc -
[- ] process > Tophat2Align -
[- ] process > Hisat2Align -
[- ] process > BWAAlign -
[- ] process > StarAlign -
[- ] process > SortRename -
[- ] process > RSeQC -
[- ] process > CreateBedgraph -
[- ] process > multiqc -
[- ] process > FeatureCount -
[- ] process > DESeq2 -
[- ] process > EdgeR -
[- ] process > Metpeak -
[- ] process > Macs2 -
[- ] process > MATKpeakCalling -
[- ] process > MeyerPrepration -
[- ] process > Meyer -
[- ] process > PeakMerge -
[- ] process > BedAnnotated -
[- ] process > MotifSearching -
[- ] process > PeaksMotifReport -
[- ] process > PeaksQuantification -
[- ] process > diffm6APeak -
[- ] process > SingleNucleotidePrediction -
[- ] process > DiffReport -
[- ] process > CreateIGVjs -
[- ] process > get_software_versions [ 0%] 0 of 1
executor > local (11)
[b1/660778] process > CheckDesignCompare [100%] 1 of 1, failed: 1 ✘
[01/6779e5] process > makeBED12 (gtf2bed12) [100%] 1 of 1, failed: 1 ✘
[bc/441837] process > makechromesize (gtf2bed12) [100%] 1 of 1, failed: 1 ✘
[- ] process > MakeTophat2Index -
[- ] process > MakeHisat2Index -
[- ] process > MakeBWAIndex -
[a0/dd4b7e] process > MakeStarIndex (star_index) [100%] 1 of 1, failed: 1 ✘
[- ] process > MakerRNAindex -
[69/b5fa1d] process > Fastp (control_1.ip) [ 88%] 7 of 8, failed: 7[- ] process > Fastqc -
[- ] process > Tophat2Align -
[- ] process > Hisat2Align -
[- ] process > BWAAlign -
[- ] process > StarAlign -
[- ] process > SortRename -
[- ] process > RSeQC -
[- ] process > CreateBedgraph -
[- ] process > multiqc -
[- ] process > FeatureCount -
[- ] process > DESeq2 -
[- ] process > EdgeR -
[- ] process > Metpeak -
[- ] process > Macs2 -
[- ] process > MATKpeakCalling -
[- ] process > MeyerPrepration -
[- ] process > Meyer -
[- ] process > PeakMerge -
[- ] process > BedAnnotated -
[- ] process > MotifSearching -
[- ] process > PeaksMotifReport -
[- ] process > PeaksQuantification -
[- ] process > diffm6APeak -
[- ] process > SingleNucleotidePrediction -
[- ] process > DiffReport -
[- ] process > CreateIGVjs -
[- ] process > get_software_versions [ 0%] 0 of 1
Execution cancelled -- Finishing pending tasks before exit
Error executing process > 'MakeStarIndex (star_index)'

executor > local (11)
[b1/660778] process > CheckDesignCompare [100%] 1 of 1, failed: 1 ✘
[01/6779e5] process > makeBED12 (gtf2bed12) [100%] 1 of 1, failed: 1 ✘
[bc/441837] process > makechromesize (gtf2bed12) [100%] 1 of 1, failed: 1 ✘
[- ] process > MakeTophat2Index -
[- ] process > MakeHisat2Index -
[- ] process > MakeBWAIndex -
[a0/dd4b7e] process > MakeStarIndex (star_index) [100%] 1 of 1, failed: 1 ✘[- ] process > MakerRNAindex -
[69/b5fa1d] process > Fastp (control_1.ip) [ 88%] 7 of 8, failed: 7
[- ] process > Fastqc -
[- ] process > Tophat2Align -
[- ] process > Hisat2Align -
[- ] process > BWAAlign -
[- ] process > StarAlign -
[- ] process > SortRename -
[- ] process > RSeQC -
[- ] process > CreateBedgraph -
[- ] process > multiqc -
[- ] process > FeatureCount -
[- ] process > DESeq2 -
[- ] process > EdgeR -
[- ] process > Metpeak -
[- ] process > Macs2 -
[- ] process > MATKpeakCalling -
[- ] process > MeyerPrepration -
[- ] process > Meyer -
[- ] process > PeakMerge -
[- ] process > BedAnnotated -
[- ] process > MotifSearching -
[- ] process > PeaksMotifReport -
[- ] process > PeaksQuantification -
[- ] process > diffm6APeak -
[- ] process > SingleNucleotidePrediction -
[- ] process > DiffReport -
[- ] process > CreateIGVjs -
[- ] process > get_software_versions [ 0%] 0 of 1
Error executing process > 'MakeStarIndex (star_index)'

Caused by:
Process MakeStarIndex (star_index) terminated with an error exit status (127)

Command executed:

mkdir StarIndex
STAR --runThreadN 2 --runMode genomeGenerate --genomeDir StarIndex --genomeFastaFiles TEST.fa --sjdbGTFfile TES
T.gtf --sjdbOverhang 49 --limitGenomeGenerateRAM 36000000000
Command exit status:
127

Command output:
(empty)

Command error:
/bin/bash: line 0: cd: /GPFS/zhangli_lab_temp/wangyanmin/meripseqpipe/2/work/a0/dd4b7e53ea2615b9da7b88c2684c2d: No such file or directory
/bin/bash: .command.run: No such file or directory

Work dir:
/GPFS/zhangli_lab_temp/wangyanmin/meripseqpipe/2/work/a0/dd4b7e53ea2615b9da7b88c2684c2d

Tip: view the complete command output by changing to the process work dir and entering the command cat .command.out

Parameter hisat2_index do not work

Hisat2 index work as hasit2 -1 fq1.fq -2 fq2.fq -x path/to/index/index_prefix.
Actually, the index is composed of 8 files:
path/to/index/index_prefix.1.ht2 path/to/index/index_prefix.2.ht2 ...... path/to/index/index_prefix.8.ht2
MePIPseqPipe will create a soft link in working directory according to what I provided in nextflow.config.
So, if I wrote hisat2_index = "path/to/index/index_prefix", it will create a broken link named index_prefix.
And, if I wrote hisat2_index = "path/to/index", it will create a symbol index that link to path/to/index. Howerver, hisat to will report an error, because it need index/index_prefix rather than index/

MACS2 -g parameter

Hi, Dear developer.
I noticed the default paramter about MACS2 in MeRIPseqPipe is

MACS2 2.1.2 default, -q 0.01 --keep-dup 5 -f BAM --nomodel

It seems that it use the default "-g hs " , which is 2.7e9. But how can I change the -g paramters for my species, which is more smaller than human?

how to set the -p task.cpus in parameters

Hi, Dear developer
I want to set the threads or cpus in parameters because I find it seems MeRIPseqPipe will just use one cpus for each jobs. I have seen many jobs use task.cpus

$ grep task.cpus main.nf 
        hisat2-build -p ${task.cpus} -f $fasta --exon Hisat2Index/${fasta.baseName}.exon --ss Hisat2Index/${fasta.baseName}.ss Hisat2Index/${fasta.baseName}
        STAR --runThreadN ${task.cpus} \
    hisat2-build -p ${task.cpus} -f $rRNA_fasta rRNAindex/${rRNA_fasta.baseName}
            fastp -i ${reads} -o ${add_aligners} -j ${sample_name}_fastp.json -h ${sample_name}_fastp.html -w ${task.cpus}
            fastp -i ${reads[0]} -o ${add_aligners_1} -I ${reads[1]} -O ${add_aligners_2} -j ${sample_name}_fastp.json -h ${sample_name}_fastp.html -w ${task.cpus}
            -p ${task.cpus} --dta --un-gz ${sample_id}.fastq.gz \
            samtools view -@ ${task.cpus} -Shub - | \
            samtools sort -@ ${task.cpus} -o ${sample_name}_rRNA_sort.bam -
            -p ${task.cpus} --dta --un-conc-gz ${sample_name}_fastq.gz \
            samtools view -@ ${task.cpus} -Shub - | \
            samtools sort -@ ${task.cpus} -o ${sample_name}_rRNA_sort.bam -
        tophat  -p ${task.cpus} \

I have read the documents, but it seems that it do not mention that how to set the task.cpus for each jobs.
So I am wondering whehther you can help me.

Please forgive me if I misunderstand something :)

Best wishes

Guandong Shang

Is picard/MarkDuplicates necessary before running peak calling?

Hi @juneb4869 ,

Sorry to bother you again. I have successfully run MeRIPseqPipe on my own data. Now I have a question about dpulicate reads after alignment. In my data, I have ~20-47% duplicate reads for each sample accorrding to MultiQC report (see the following image). So I am wondering does this effect the peak calling results significantly? Do I need maybe run Picard before peak calling, just as the nf-core rnaseq pipeline?
image

Best,
Peng

Designfile definitions question

Hi all,

first thank you very much for providing this resource!

I would like to try MeRIPseqPipe, but I'm currently unsure how to describe the data with the Designfile and Comparefile.

My data looks like this:
I have three replicates for each condition (WT and KO), and for each replicate an input and IP BAM file.

How would this work with the Sample_ID and Group_ID columns? Group_ID would be WT and KO I guess, but where to specify the input and IP pairs?

Thanks & Best,
Michael

MeRIPseqPipe running in docker was too slow.

Hi @likelet @canceromics @juneb4869 ,

Thank you guys for this awesome automated MeRIPseq analysis pipeline. I deployed this pipeline on my server and the test run went through smoothly within a short time. However, When I was trying to run my data, the pipeline was quite slow. Many of the steps run only one core, even if I set 32 cores and 256.GB memory available. Can you check for me how to make it run faster, please? Thank you!

  // Defaults only, expecting to be overwritten
  max_memory = 256.GB
  max_cpus = 32
  max_time = 2400.h

Best,
Jianxiang

pipeline error at PeaksMotifReport and diffm6APeak steps

Hi I am trying to run the pipeline am getting two different errors. I have run it a couple times and I think the difference just depends on which process it tries to run first but the issues are with diffm6APeak and PeaksMotifReport. For PeaksMotifReport, it seems to copy the Peaks_Motif_Report.rmd file but must be having an issue with the R script because the PeakMotifPlot.RData file is not in the working directory. For diffm6APeak
Any ideas what could be causing these errors?

PeaksMotifReport error:

[-        ] process > BWAAlign                                   -
[ff/f6a0eb] process > StarAlign (SRX9973063_SRR13574981)         [100%] 12 of 12 ✔
[a7/543845] process > SortRename (transgene_rep1.ip_transgene)               [100%] 12 of 12 ✔
[48/0d1da9] process > RSeQC (transgene_rep1.ip_transgene)                    [100%] 12 of 12 ✔
[-        ] process > CreateBedgraph                             -
[00/9aeb09] process > multiqc                                    [100%] 1 of 1 ✔
[38/f820ef] process > FeatureCount                               [100%] 1 of 1 ✔
[32/1045b9] process > DESeq2 (transgenemut_vs_control)                 [100%] 2 of 2 ✔
[-        ] process > EdgeR                                      -
[7b/195bae] process > Metpeak (WT_rep2)                          [100%] 6 of 6 ✔
[77/c13c08] process > Macs2 (transgene_rep1)                           [100%] 6 of 6 ✔
[-        ] process > MATKpeakCalling                            -
[-        ] process > MeyerPrepration                            -
[-        ] process > Meyer                                      -
[18/6b35da] process > PeakMerge                                  [100%] 1 of 1 ✔
[46/38c775] process > BedAnnotated (macs2_WT_rep2_normalized)    [100%] 16 of 16 ✔
[3d/17b8d7] process > MotifSearching (rank_merged_group_control) [100%] 4 of 4 ✔
[f7/ce2e75] process > PeaksMotifReport                           [100%] 1 of 1, failed: 1 ✘
[52/b8634e] process > PeaksQuantification                        [100%] 1 of 1 ✔
[-        ] process > diffm6APeak                                -
[b8/3d5ca7] process > SingleNucleotidePrediction                 [100%] 1 of 1 ✔
[-        ] process > DiffReport                                 -
[-        ] process > CreateIGVjs                                -
[c6/82fd5a] process > get_software_versions                      [100%] 1 of 1 ✔
Error executing process > 'PeaksMotifReport'

Caused by:
  Process `PeaksMotifReport` terminated with an error exit status (1)

Command executed:

  cp /software/MeRIPseqPipe/bin/Peaks_Motif_Report.rmd ./
  Rscript /software/MeRIPseqPipe/bin/Peaks_Motif_Report.R formatted_designfile.txt rank independence PeakMotifPlot.RData
  R -e "load(\"PeakMotifPlot.RData\");rmarkdown::render('Peaks_Motif_Report.rmd',output_file='Peaks_Motif_Report_rank.html')"

Command exit status:
  1

Command output:
  (empty)

Command error:
  Error in scan(file = file, what = what, sep = sep, quote = quote, dec = dec,  : 
    line 2705 did not have 17 elements
  Calls: read.table -> scan
  Execution halted

Work dir:
 /merip/work/f7/ce2e757763c249b7a87262e96eff89

Tip: when you have fixed the problem you can continue the execution adding the option `-resume` to the run command line

diffm6aPeak error:

Differential m6A analysis is going on by bedtools
Differential m6A analysis is going on by bedtools
Execution cancelled -- Finishing pending tasks before exit
[MeRIPseqPpipe] Pipeline completed with errors
WARN: There's no process matching config selector: fastp -- Did you mean: Fastp?
WARN: There's no process matching config selector: sort
WARN: Failed to render execution report -- see the log file for details
WARN: Failed to render execution timeline -- see the log file for details
WARN: Graphviz is required to render the execution DAG in the given format -- See http://www.graphviz.org for more info.
Error executing process > 'diffm6APeak (transgenemut_vs_control)'

Caused by:
  Process `diffm6APeak (transgenemut_vs_control)` terminated with an error exit status (1)

Command executed:

  case Wilcox-test in 
      Wilcox-test)
          Rscript /opt/software/MeRIPseqPipe/bin/bedtools_diffm6A.R formatted_designfile.txt bedtools_quantification.matrix transgenemut_vs_control
          ;;
      QNB)
          Rscript /opt/software/MeRIPseqPipe/bin/QNB_diffm6A.R formatted_designfile.txt rank_merged_allpeaks.bed transgenemut_vs_control   
          ;;
      MATK)
          export OMP_NUM_THREADS=15
          if [ ! -f "/MATK-1.0.jar" ]; then
              echo "Cannot find matk.jar. Please check the param of matk_jar" 1>&2
              exit 1
          fi
          bash /opt/software/MeRIPseqPipe/bin/MATK_diffm6A.sh /MATK-1.0.jar formatted_designfile.txt Oryza_sativa.IRGSP-1.0.56.chr.gtf transgenemut_vs_control rank_merged_allpeaks.bed
          ;;
      edgeR)
          Rscript /opt/software/MeRIPseqPipe/bin/GLM_edgeR_DM.R formatted_designfile.txt transgenemut_vs_control bedtools_quantification.matrix expression.star.count.matrix   
          ;;
      DESeq2)
          Rscript /opt/software/MeRIPseqPipe/bin/GLM_DESeq2_DM.R formatted_designfile.txt transgenemut_vs_control 15 bedtools_quantification.matrix expression.star.count.matrix 
          ;;
      *)
          echo Wilcox-test" is not Wilcox-test, QNB, MATK, DESeq2 or edgeR"
          exit 1
          ;;
  esac

Command exit status:
  1

Command output:
  (empty)

Command error:
  Error in scan(file = file, what = what, sep = sep, quote = quote, dec = dec,  : 
    line 3240 did not have 9 elements
  Calls: read.table -> scan
  Execution halted

design file contents:

cat formatted_designfile.txt
Sample_ID,input_FileName,ip_FileName,Group
transgene_rep1,transgene_rep1.input,transgene_rep1.ip,transgene
transgene_rep2,transgene_rep2.input,transgene_rep2.ip,transgene
Mut_rep1,Mut_rep1.input,Mut_rep1.ip,transgenemut
Mut_rep2,Mut_rep2.input,Mut_rep2.ip,transgenemut
WT_rep1,WT_rep1.input,WT_rep1.ip,control
WT_rep2,WT_rep2.input,WT_rep2.ip,control

What is corresponding file to the Volcano Plot

Dear developer,

I got this Volcano Plot of Different Methylation. I wonder what is the file corresponding to the volcano plot. I have checked the m6AAnalysis/diffm6A/edgeR_diffm6A_A_Y.txt, but the numbers don't match with the numbers in the plot.

image

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.