Comments (9)
@beyondblog 这个我想过,需要改代码。现在的策略是直接 RDB restore 给 slave,单数据太大的话,肯定失败 (>512MB),这种时候,看来需要手动的切成小的指令,比如 RPUSH 来操作。
from redis-port.
@beyondblog 不过从你的 log 上,你并不是这个问题。出错在于命令解析错误,不合法。
from redis-port.
@beyondblog 现在应该可以了,pull 最新的代码试试看。
from redis-port.
@spinlock 非常感谢! 稍后我试下! 😄
from redis-port.
@spinlock 我也越到了一样的问题
2017/03/16 11:02:25 sync.go:235: [INFO] total=2908349195 - 2864928461 [ 98%] entry=5111118
2017/03/16 11:02:26 sync.go:235: [INFO] total=2908349195 - 2868982634 [ 98%] entry=5120844
2017/03/16 11:02:27 sync.go:235: [INFO] total=2908349195 - 2873281677 [ 98%] entry=5130978
2017/03/16 11:02:28 sync.go:235: [INFO] total=2908349195 - 2878549522 [ 98%] entry=5141108
2017/03/16 11:02:29 sync.go:235: [INFO] total=2908349195 - 2884614954 [ 99%] entry=5157670
2017/03/16 11:02:30 sync.go:235: [INFO] total=2908349195 - 2891919471 [ 99%] entry=5172628
2017/03/16 11:02:31 sync.go:235: [INFO] total=2908349195 - 2898386154 [ 99%] entry=5185882
2017/03/16 11:02:32 sync.go:235: [INFO] total=2908349195 - 2903861685 [ 99%] entry=5196923
2017/03/16 11:02:33 sync.go:235: [INFO] total=2908349195 - 2908300354 [ 99%] entry=5207640
2017/03/16 11:02:33 sync.go:235: [INFO] total=2908349195 - 2908349187 [ 99%] entry=5211041
2017/03/16 11:02:33 sync.go:237: [INFO] sync rdb done
2017/03/16 11:02:33 sync.go:259: [PANIC] parse command arguments failed
[error]: expect Array, but got <*redis.BulkBytes>
2 /usr/local/share/go/src/github.com/CodisLabs/redis-port/pkg/redis/resp.go:163
github.com/CodisLabs/redis-port/pkg/redis.AsArray
1 /usr/local/share/go/src/github.com/CodisLabs/redis-port/pkg/redis/handler.go:88
github.com/CodisLabs/redis-port/pkg/redis.ParseArgs
0 /usr/local/share/go/src/github.com/CodisLabs/redis-port/cmd/sync.go:258
main.(*cmdSync).SyncCommand.func2
已经是最新的代码了,是从一个redis服务导入数据到codis-proxy,每次都是到99%的时候,出现这个问题
from redis-port.
@luweijie007 这个很奇怪。。。
先说你已经完成 rdb 同步了,错误出现在追 log 的过程。但是 log 应该都是 BulkBytes Array 才对的。我不确定是不是 redis 某个版本改了协议还是我处理的有问题。
from redis-port.
redis的版本和同步时候的日志如下,很正常,还有有用的信息我能查看的?
redis_version:3.0.6
3310:S 16 Mar 11:20:37.271 * Slave 10.15.107.143: asks for synchronization
3310:S 16 Mar 11:20:37.272 * Full resync requested by slave 10.15.107.143:
3310:S 16 Mar 11:20:37.272 * Starting BGSAVE for SYNC with target: disk
3310:S 16 Mar 11:20:37.279 * Background saving started by pid 6412
6412:C 16 Mar 11:21:24.306 * DB saved on disk
6412:C 16 Mar 11:21:24.307 * RDB: 6374 MB of memory used by copy-on-write
3310:S 16 Mar 11:21:24.415 * Background saving terminated with success
3310:S 16 Mar 11:30:00.668 * Synchronization with slave 10.15.107.143: succeeded
3310:S 16 Mar 11:30:08.991 # Connection with slave client id #20 lost.
是不是同步的数据太大6374 MB?
补充一下,redis服务的配置rdbchecksum 是关闭的,codis-port里面检查checksum的地方修改跳过检查,
这个有影响吗?
from redis-port.
from redis-port.
--sockfile=FILE [--filesize=SIZE,这2个参数吗?具体怎么设值,能贴下吗?
from redis-port.
Related Issues (20)
- make HOT 1
- redis4.0.1迁移到codis3.2.2报错 HOT 9
- 编译命令 HOT 3
- Twemproxy 迁移数据到codis报错 HOT 3
- redis2.x迁移至4.x报错 HOT 5
- codis集群 3.2往Redis单实例 2.8版本迁移出错 HOT 1
- M/S迁移数据到cluster报错
- 2.8.8单节点redis 迁移到codis 3.2集群 报错
- 从redis 3.2实例导入到相同的redis 3.2实例中报错
- 【bug】redis-sync密码带有'@'的时候无法正确解析密码 HOT 1
- how to install it HOT 1
- fix auth
- how to know which redis version is corresponded to the release version
- 使用redis-restore将rdb文件导入集群失败,导入单机就正常
- 支持ssl连接到aws上的redis吗 HOT 1
- redis 5.x support HOT 1
- 从 redis2.x迁移至redis5.0
- invalid RDB version number 9 HOT 7
- 迁移redis到codis报错 [PANIC] encode redis resp failed
- 带过期时间key丢失
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from redis-port.