Comments (10)
I should add these pauses date back to 10th February and I don't think our IO would be the cause, but I'll check with iftop tomorrow.
Apart from this, some excellent MKV transcodes are cooking here! Thanks so much.
from rawcooked.
I'm having repeated issues with very large files reaching the end of the first RAWcooked analysis, and then stalling.
You mean that this is not always the case i.e. for a same dir sometimes it works, sometimes not?
Analyzing files (100.32%), 5 file/s
More than 100%!!! and slow...
Could you provide the output of ls -lR
on the dir?
So I could try to reproduce the same kind of attachments / content without the files.
It will be long to debug :(.
But also I plan to rework this part (multithreading for not depending on I/O latency), with some luck it would remove this issue, but no ETA :(.
from rawcooked.
Hi Jérôme, thanks for quick response.
I've been investigating the sibling folders as they're split from the same original sequence. There are error messages featuring in the logs for the RAWcooked, but MKV files are building:
[ffv1 @ 0x55a89be576c0] Cannot allocate worst case packet size, the encoding could fail speed = 0.00141x
I attach the ls output for a folder which has frozen.
Happy to send any sample DPX you may need.
Thanks,
Joanna
from rawcooked.
There are error messages featuring in the logs for the RAWcooked, but MKV files are building:
[ffv1 @ 0x55a89be576c0] Cannot allocate worst case packet size, the encoding could fail speed = 0.00141x
Not error message, only warning, due to size of image, "worst case" do not happen in practice (and if so, the encoding would fail so visible).
I attach the ls output for a folder which has frozen.
Very few and small attachments, classic layout, very weird.
I've been investigating the sibling folders as they're split from the same original sequence.
So same kind, but different content "only", weird!
I am afraid that I need the full content for reproducing, and/or I need to have more log. I bet I could not reproduce so maybe the way to go is to have more logging, I'll implement more logging so you can see when it is frozen where it is frozen.
BTW, if you try again with the same folder, is it fine, i.e. is this freeze easily reproducible? If so, even without using GNU Parallel?
from rawcooked.
Thanks Jérôme, good to know that the warning isn't critical.
More logging sounds good, I'll await a new snapshot.
I'll will try cooking this problem item directly now without Parallel and let you know how it goes.
Many thanks,
Joanna
from rawcooked.
The folder is RAWcooked encoding using a direct command Jérôme, I'll monitor my IO for a while today also and see if we have issues there. Not sure if it's relevant but the ffmpeg command being used has a framerate of 24.000002, when all rest are straight 24.000000.
from rawcooked.
Morning, I can confirm that transcode completed manually over the weekend okay Jérôme. Any more I encounter with this issue I'll cook manually, it could be a conflict with GNU parallel. Many thanks!
from rawcooked.
I plan to refactor the analysis part, as it is not blocking your work it seems less urgent, I think I'll wait for this work before adding more logs and so on.
Let me know if it is too much often.
from rawcooked.
from rawcooked.
as these workflows are now so critical
Please consider if that would help, and let me know?
For the moment I am blocked by MediaInfo related projects during the next months, but with no other big projects in the pipe (except... FFV1 fast encoder/decoder! But also related to RAWcooked).
I drop an email with more details.
from rawcooked.
Related Issues (20)
- License should be checked before processing all DPX
- Computer build recommendation? HOT 2
- Mono audio not supported by free license? HOT 2
- Logs recommend use of 'version 2' for excess non-zero padding data HOT 1
- Logfile as option like --logfile HOT 4
- dpx folder name when converting MKV --> DPX HOT 4
- consider ffmpeg default metadata mapping
- Error: undecodable files from output are not same as files from source
- Error: undecodable DPX version number of header format HOT 6
- Development request for encoding timings in logs
- What data would be (potentially) missing? HOT 2
- Valid header data differences when ditto key = 0 HOT 2
- -all command plus --no-accept-gaps not exiting with -y flag
- Segmentation Fault 11 on One of Two Macs HOT 6
- sh: ffmpeg: command not found HOT 3
- Some DPX Sequences Result In MKV Files that are Not Valid HOT 10
- Question re. --info HOT 1
- Warning: non-conforming DPX total image file size HOT 4
- More details about errors
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from rawcooked.