Comments (12)
Hi @antonzhelyazkov, please review your issue : https://ftpgrab.github.io/doc/reporting-issue/
Thanks for your support
from ftpgrab.
Hi,
I tried to investigate the problem. We have strange circumstances - files in different directories have same names! For example:
Process file: animalplanet/EPG-14-01-2018.xml
Process file: discovery/EPG-14-01-2018.xml
Process file: natgeo/EPG-14-01-2018.xml
Process file: eurosport/EPG-14-01-2018.xml
Process file: 24kitchen/EPG-14-01-2018.xml
Problem occurs when files are already downloaded
Here are other information about our system
awk -W version
GNU Awk 3.1.7
configuration file
cat /usr/local/ftpgrab/conf/all.conf
DIR_DEST="/path/to/dir/"
EMAIL_LOG="[email protected]"
DEBUG=0
FTP_HOST="xxx.xxx.xxx.xxx"
FTP_PORT="21"
FTP_USER="1qaz"
FTP_PASSWORD="qwerty"
FTP_SOURCES="/"
FTP_SECURE=0
FTP_CHECK_CERT=0
DL_METHOD="wget"
DL_USER="epg"
DL_GROUP="epg"
DL_CHMOD=""
DL_REGEX=""
DL_EXCLUDE_REGEX=""
DL_RETRY=3
DL_RESUME=0
DL_SHUFFLE=0
DL_HIDE_SKIPPED=0
DL_HIDE_PROGRESS=1
DL_CREATE_BASEDIR=0
HASH_ENABLED=1
HASH_TYPE="md5"
HASH_STORAGE="text"
Configuration
Operating system and platform : Centos 6 64bits
ftpgrab version : 4.3
wget version : 1.12
curl version : 7.19.7
md5sum / sha1sum version : 8.4
sqlite3 version : 3.6.20
from ftpgrab.
Hi, can you reproduce the problem with DEBUG=1 in the config fileand post your log file please ?
Thanks
from ftpgrab.
Hi @crazy-max,
here is output with debug mode
--------------
#DEBUG lineClean: /24techno/
#DEBUG basename: 24techno
#DEBUG srcfile: /24techno
#DEBUG srcfileproc: /24techno
#DEBUG srcfileshort: 24techno
#DEBUG srcfileshort2: 24techno
#DEBUG srchash: 564aa1020059848f23e017d436a42f4a
#DEBUG srcsize:
#DEBUG destfile: /home/epg/ftp/24techno
#DEBUG destsize: N/A
#DEBUG vregex: 24techno
#DEBUG lineClean: /24techno/EPG-05-01-2018.xml
#DEBUG basename: EPG-05-01-2018.xml
#DEBUG srcfile: /24techno/EPG-05-01-2018.xml
#DEBUG srcfileproc: /24techno/EPG-05-01-2018.xml
#DEBUG srcfileshort: 24techno/EPG-05-01-2018.xml
#DEBUG srcfileshort2: 24techno/EPG-05-01-2018.xml
#DEBUG srchash: e2a6a52362d400241cbb94fcf242e071
#DEBUG srcsize: 5748
#DEBUG destfile: /home/epg/ftp/24techno/EPG-05-01-2018.xml
#DEBUG destsize: 5748
#DEBUG vregex: 24techno/EPG-05-01-2018.xml
/usr/local/ftpgrab/ftpgrab.sh: line 73: [: e2a6a52362d400241cbb94fcf242e071: binary operator expected
Process file: 24techno/EPG-05-01-2018.xml
Hash: e2a6a52362d400241cbb94fcf242e071
Size: 5.61 Kb
Status: Already downloaded and valid. Skip download...
Time spent: 00:00:00
from ftpgrab.
Ok thx i keep u in touch
from ftpgrab.
Can you post your hash file please ? It seems there is unexpected symbols.
from ftpgrab.
Hi, here is hash file
from ftpgrab.
Thanks i've found the issue
from ftpgrab.
Do you want to setup FTP with our or send you our ftp root with all files to reproduce the problem at your site?
from ftpgrab.
No thanks @antonzhelyazkov, i've got everything i need.
Will be solved in the next release.
from ftpgrab.
Has been solved in the latest release (4.3.1)
from ftpgrab.
Great :)
Now script works correctly.
from ftpgrab.
Related Issues (20)
- Feature Request - option to disable time in logging output HOT 2
- ftpgrab fails to authenticate while curl is OK with the same credentials HOT 2
- Feature Request - Add a optional configuration parameter to run custom script when sync is completed. HOT 6
- The debug log prompts to list files, but does not download the files in this folder HOT 3
- [Doc Page] Page instructions "Linux Service" is wrong. HOT 2
- Cannot create grabber HOT 1
- Error: FTL Cannot start [container] (Docker on Synology) HOT 2
- Tool can't work with server containing folders with cp1251 charset
- can't work on folder with "([." carracter HOT 1
- Docker Container Stops after Finishing HOT 2
- Folder with "." are Ignored HOT 2
- Need help with working out if FTPGrab can do this.
- Threads & Paralel Mirroing HOT 2
- Cannot connect to server: dial tcp 127.0.0.1:21: connect: connection refused HOT 1
- Discord notifications
- Cannot connect to server HOT 3
- File permissions not created properly?
- Cannot move file error: invalid cross-device link HOT 5
- Unable to connect to server HOT 6
- Access denide HOT 12
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from ftpgrab.