x1wins / cw-ovp Goto Github PK

View Code? Open in Web Editor NEW

27.0 2.0 10.0 21.83 MB

video packaging to *.m3u8 for HLS (HTTP Live Streaming) with FFMPEG on website (ruby on rails)

License: GNU General Public License v2.0

Ruby 58.89% JavaScript 12.47% CSS 0.49% HTML 24.46% Shell 1.48% Dockerfile 0.84% SCSS 1.08% Python 0.26% Procfile 0.03%

hls m3u8 ffmpeg transcoding mp4 ruby-on-rails-6 packaging streaming-service http-live-streaming m3u8-playlist

cw-ovp's Introduction

CW-OVP

Preview
Introduction
- EN
- KO
Tech Stack
Feature
System Structure
Getting started
Minimum Requirements for Production
Roadmap
Deploy
- Kubernetes
- Docker Swarm
Webhook

Preview

Introduction

EN

OVP(online video platform) mean that online transcoding, packaging and hosting service with video file upload to online storage or cloud system.
Internet speed was increase and many internet user prefer to streaming service for Mobile, web, OTT than service from over-the-air television networks. but streaming service use OVP or solution for start streaming service with Mobile, web, OTT(over the top). such as OVP and some solution require many spend money for streaming service.
Famous OVP business company is brightcove.com, mux.com, dacast.com, vimeo.com, Dacast.com, Amazon elastic transcoding and Wowza solution.
CW-OVP project will commit helping for who want ready for streaming service.
This is why CW-OVP project was built.

KO

OVP(online video platform)란
온라인 저장소 또는 클라우드에 비디오 파일을 업로드하여 트랜스코딩과 페키징 처리후 호스팅 서비스를 제공함을 말한다.
인터넷 속도의 발달과 사용자들의 요구로 많은 스트리밍 서비스가 생겨나고 있고, 기존의 방송사들도 흐름에 따라 Mobile, web, OTT(over the top) 셋탑기기의 스트리밍 서비스를 제공하기 위해서 OVP(online video platform)이나 솔류션을 많이 사용하고 있다.
대표적인 해외 OVP는 brightcove.com, mux.com, dacast.com, vimeo.com, Dacast.com, Amazon elastic transcoding 등 서비스들이 존재하며 솔류션으로는 Wowza가 존재한다.
이에 CW-OVP 프로젝트를 오픈소스로 개발하여 기업이나 단체, 개인에 도움이 되고자 한다.

Tech Stack

what use	description
FFMPEG	video transcoding, packaging
h.264	Codec
HLS	Protocol
Ruby on Rails	web framework, websocket(action cable)
Redis	queue, pub/sub
Sidekiq	background job, queue
Postresql	database
Docker, docker-compose	install environment
Docker Swarm	Clustering
Kubernetes	Clustering

you can choose Docker swarm or Kubernetes(kops or EKS) for Clustering

Feature

Clustering ffmpeg worker with sidekiq on Docker swarm or Kubernetes
Transcoding, Packaging with ffmpeg for HLS
- Generated multiple m3u8 for Adaptive Streaming
Extract 10 random Thumbnail images during video packaging
AWS S3 for stored video, thumbnail assets
AWS Cloudfront for CDN
Real time base on web UI with websocket(Action Cable), ruby on rails
Open source (GPL-2.0 License) and Free, but need hardware…

System Structure

If your node for database that got fault or something wrong, You can lost persistent in database. that's why I recommend AWS RDS for postgresql.

Getting started

Storage config

AWS S3 Storage
1. How to make s3 bucket for AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY
  - https://www.changwoo.org/[email protected]/2019-10-23/Upload-file-to-S3-with-AWS-CLI-d12442012c
2. How to make cloudfront url for AWS_CLOUDFRONT_DOMAIN
  - https://www.changwoo.org/[email protected]/2019-10-23/using-cloud-front-with-s3-51d2eb17bb
3. Update .env.dev.s3 file for s3, cloudfront
  1. open .env.dev.s3
  2. add below of code and update each value
```
    AWS_ACCESS_KEY_ID=[Change key id]
    AWS_SECRET_ACCESS_KEY=[Change access key]
    REGION=[Change region (us-west-1 or us-west-2 or us-east-1...)]  
    BUCKET=[Change bucket]
    CDN_BUCKET=[Change cdn bucket]
    AWS_CLOUDFRONT_DOMAIN=[Change cdn domain]
```
  3. Check config
```
docker-compose --env-file .env.dev.s3 config
```
4. ignore changed .env.dev.s3 file when git commit
```
   git update-index --assume-unchanged .env.dev.s3
```

How To Run Development mode with Docker-compose

Download source
1. git clone https://github.com/x1wins/CW-OVP.git
2. cd ./CW-OVP
Build and Run
1. docker-compose --env-file .env.dev.s3 up --build -d
2. docker-compose run --no-deps web bundle exec rails webpacker:install
3. docker-compose --env-file .env.dev.s3 restart web
4. docker-compose run --no-deps web bundle exec rake db:create
5. docker-compose run --no-deps web bundle exec rake db:migrate
6. docker-compose run --no-deps web bundle exec rake db:create RAILS_ENV=test
7. docker-compose run --no-deps web bundle exec rake db:migrate RAILS_ENV=test

Restart for updated code

git fetch origin develop
git reset --hard origin/develop

Restart web, sidekiq

docker-compose --env-file .env.dev.s3 restart web
docker-compose --env-file .env.dev.s3 restart sidekiq

Unit testing with rspec

docker-compose run --no-deps web bundle exec rspec --format documentation

Console

docker-compose run --no-deps web bundle exec rails console

Troubleshooting

when I got bundle error such as minemagic

Log of minemagic gem error

Step 10/16 : RUN bundle install
---> Running in 578d62fab6ac
Fetching gem metadata from https://rubygems.org/............
You have requested:
 mimemagic ~> 0.4.1
The bundle currently has mimemagic locked at 0.3.5.
Try running `bundle update mimemagic`
If you are updating multiple gems in your Gemfile at once,
try passing them all to `bundle update`
ERROR: Service 'web' failed to build: The command '/bin/sh -c bundle install' returned a non-zero code: 7
The command "docker-compose build" failed and exited with 1 during .
Your build has been stopped.

Solution

docker-compose run --no-deps web bundle update mimemagic

Keep latest gem for defense vulnerability

docker-compose run --no-deps web bundle update
docker-compose run --no-deps web yarn upgrade --latest

no space left on device

https://www.changwoo.org/[email protected]/2021-02-12/write-myapp-tmp-redis-appendonly-aof-9ff1127366

Log

% docker-compose --env-file .env.dev.s3 up --build
Building web
Step 1/16 : FROM ruby:2.6.3
 ---> 8fe6e1f7b421
Step 2/16 : RUN curl -sL https://deb.nodesource.com/setup_12.x | bash - &&     curl -sS https://dl.yarnpkg.com/debian/pubkey.gpg | apt-key add - &&     echo "deb https://dl.yarnpkg.com/debian/ stable main" | tee /etc/apt/sources.list.d/yarn.list &&     apt-get update &&     apt-get install -qq -y build-essential nodejs yarn vim     libpq-dev postgresql-client ffmpeg
 ---> Using cache
 ---> 14eb2f07d9e5
Step 3/16 : RUN apt-get update &&     apt-get install -y         python3         python3-pip         python3-setuptools         groff         less     && pip3 install --upgrade pip     && apt-get clean
 ---> Using cache
 ---> c57e46926299
Step 4/16 : RUN pip3 --no-cache-dir install --upgrade awscli
 ---> Using cache
 ---> 7e8e641bfc90
Step 5/16 : RUN mkdir /myapp
 ---> Using cache
 ---> a0a39c82945a
Step 6/16 : RUN mkdir /storage
 ---> Using cache
 ---> 66348ad31ef0
Step 7/16 : WORKDIR /myapp
 ---> Using cache
 ---> 47b601075951
Step 8/16 : COPY . /myapp
ERROR: Service 'web' failed to build : Error processing tar file(exit status 1): write /myapp/tmp/storage/og/op/ogopd3w9xnrwq0b6kqf8beh726xu: no space left on device

Solution

% docker system prune
WARNING! This will remove:
  - all stopped containers
  - all networks not used by at least one container
  - all dangling images
  - all dangling build cache

Are you sure you want to continue? [y/N] y

How To Run Development mode without docker

SETUP_WITHOUT_DOCKER.md

Sample video file download

Minimum Requirements for Production

Required AWS S3 for Storage
Required AWS Cloudfront for CDN
Server Spec
- CPU
  - 8 or more Cpu per server (c5.2xlarge on aws ec2)
- Disk
  - more 10 Gb
  - if you will upload heavy video or more 10Gb, need more space
- Memory
  - more 2Gb
- Number of Server
  - master : 1 or more
  - slave : 2 or more

Roadmap

Deploy

kubernetes

K8s with kops for Production

Docker Swarm

DOCKER-SWARM.md

Webhook

cw-ovp's People

Contributors

Stargazers

Watchers

Forkers

marcelpoelstra krzemienski rubyci bluengreen sdglobaltech jorgelab michal944 calvinti12 dangquochuy1993

cw-ovp's Issues

Travis build error

i did consume all credit for travis build.
because they builded this project when develop or feature branch was pushed.

i will remove badge of travis build error.

localhost of domain bug with active storage attached file url

if you use Rails.application.routes.url_helpers.url_for(t) in model or controller
need configuration of default_url_options :host => "localhost:3000"
and then they build like a http://localhost:3000/attachedfileurl
but if you deploy to where hasn't localhost domain. they will have a trouble.

ERROR: It looks like you're trying to use Nokogiri as a precompiled native gem on a system with glibc < 2.17:

$ docker-compose run --no-deps web bundle update
$ docker-compose run --no-deps web yarn upgrade --latest
$ docker-compose up --build

cw-ovp-web-1      | ERROR: It looks like you're trying to use Nokogiri as a precompiled native gem on a system with glibc < 2.17:
cw-ovp-web-1      | 
cw-ovp-web-1      |   /lib/aarch64-linux-gnu/libm.so.6: version `GLIBC_2.29' not found (required by /bundle/vendor/ruby/2.6.0/gems/nokogiri-1.13.3-aarch64-linux/lib/nokogiri/2.6/nokogiri.so) - /bundle/vendor/ruby/2.6.0/gems/nokogiri-1.13.3-aarch64-linux/lib/nokogiri/2.6/nokogiri.so
cw-ovp-web-1      | 
cw-ovp-web-1      |   If that's the case, then please install Nokogiri via the `ruby` platform gem:
cw-ovp-web-1      |       gem install nokogiri --platform=ruby
cw-ovp-web-1      |   or:
cw-ovp-web-1      |       bundle config set force_ruby_platform true
cw-ovp-web-1      | 
cw-ovp-web-1      |   Please visit https://nokogiri.org/tutorials/installing_nokogiri.html for more help.
cw-ovp-web-1      | 
cw-ovp-web-1      | /bundle/vendor/ruby/2.6.0/gems/nokogiri-1.13.3-aarch64-linux/lib/nokogiri/extension.rb:7:in `require_relative': /lib/aarch64-linux-gnu/libm.so.6: version `GLIBC_2.29' not found (required by /bundle/vendor/ruby/2.6.0/gems/nokogiri-1.13.3-aarch64-linux/lib/nokogiri/2.6/nokogiri.so) - /bundle/vendor/ruby/2.6.0/gems/nokogiri-1.13.3-aarch64-linux/lib/nokogiri/2.6/nokogiri.so (LoadError)

thumbnail image url not working

thumbnail image url not working after s3 config

force_original_aspect_ratio

i did below commit

Revert "Deleted force_original_aspect_ratio"

3bc6bc3#diff-8f620de5c39f56dd67431eb5c07b1ab5

but i got new bug that vertical video resolution has changed width to hight

Changing encode to video

*.ts File is not a valid file format

i can't upload *.ts file when i using direct upload

class Encode < ApplicationRecord
  validates :file, presence: true, blob: { content_type: :video } # supported options: :image, :audio, :video, :text

Thumbnail duplicate image show in encodes#show

thumbnail duplicate image show bug when enter to encodes#show at extract completing

ActiveRecord::ConnectionTimeoutError: could not obtain a connection from the pool within 5.000 seconds

when i upload many file. maybe 4 or more.
i got below of error log

sidekiq_1  | 2020-10-25T19:33:31.318Z pid=1 tid=gqvlr47y5 class=EncodeWorker jid=513e9b43645d323bdb8e2e47 elapsed=5.006 INFO: fail
sidekiq_1  | 2020-10-25T19:33:31.318Z pid=1 tid=gqvlr47y5 WARN: {"context":"Job raised exception","job":{"retry":false,"queue":"default","class":"EncodeWorker","args":[238],"jid":"513e9b43645d323bdb8e2e47","created_at":1603654406.3101432,"enqueued_at":1603654406.3101952},"jobstr":"{\"retry\":false,\"queue\":\"default\",\"class\":\"EncodeWorker\",\"args\":[238],\"jid\":\"513e9b43645d323bdb8e2e47\",\"created_at\":1603654406.3101432,\"enqueued_at\":1603654406.3101952}"}
sidekiq_1  | 2020-10-25T19:33:31.318Z pid=1 tid=gqvlr47y5 WARN: ActiveRecord::ConnectionTimeoutError: could not obtain a connection from the pool within 5.000 seconds (waited 5.001 seconds); all pooled connections were in use
sidekiq_1  | 2020-10-25T19:33:31.319Z pid=1 tid=gqvlr47y5 WARN: /usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/connection_pool.rb:221:in `block in wait_poll'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/connection_pool.rb:210:in `loop'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/connection_pool.rb:210:in `wait_poll'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/connection_pool.rb:171:in `internal_poll'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/connection_pool.rb:297:in `internal_poll'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/connection_pool.rb:166:in `block in poll'
sidekiq_1  | /usr/local/lib/ruby/2.6.0/monitor.rb:230:in `mon_synchronize'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/connection_pool.rb:175:in `synchronize'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/connection_pool.rb:166:in `poll'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/connection_pool.rb:875:in `acquire_connection'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/connection_pool.rb:593:in `checkout'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/connection_pool.rb:437:in `connection'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/connection_pool.rb:1119:in `retrieve_connection'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_handling.rb:221:in `retrieve_connection'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_handling.rb:189:in `connection'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/core.rb:290:in `cached_find_by_statement'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/core.rb:171:in `find'
sidekiq_1  | /myapp/app/workers/encode_worker.rb:6:in `perform'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:196:in `execute_job'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:164:in `block (2 levels) in process'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/middleware/chain.rb:133:in `invoke'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:163:in `block in process'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:136:in `block (6 levels) in dispatch'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/job_retry.rb:111:in `local'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:135:in `block (5 levels) in dispatch'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/rails.rb:14:in `block in call'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/execution_wrapper.rb:88:in `wrap'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/reloader.rb:72:in `block in wrap'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/execution_wrapper.rb:88:in `wrap'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/reloader.rb:71:in `wrap'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/rails.rb:13:in `call'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:131:in `block (4 levels) in dispatch'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:257:in `stats'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:126:in `block (3 levels) in dispatch'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/job_logger.rb:13:in `call'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:125:in `block (2 levels) in dispatch'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/job_retry.rb:78:in `global'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:124:in `block in dispatch'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/logger.rb:10:in `with'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/job_logger.rb:33:in `prepare'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:123:in `dispatch'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:162:in `process'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:78:in `process_one'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:68:in `run'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:15:in `watchdog'
sidekiq_1  | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:24:in `block in safe_thread'

raise WrongScopeError after upgrade rails 6.1

% docker-compose run --no-deps web bundle exec rspec --format documentation

Creating cw-ovp_web_run ... done

EncodesController
  GET #index
    returns a success response (FAILED - 1)
  GET #show
    returns a success response (FAILED - 2)
  GET #new
    returns a success response (FAILED - 3)
  POST #create
    with valid params
      creates a new Encode (FAILED - 4)
      redirects to the created encode (FAILED - 5)
    with invalid params
      returns a success response (i.e. to display the 'new' template) (FAILED - 6)

EncodesController
  routing
    routes to #index (FAILED - 7)
    routes to #new (FAILED - 8)
    routes to #show (FAILED - 9)
    routes to #create (FAILED - 10)

encodes/index
  renders a list of encodes (FAILED - 11)

encodes/new
  renders new encode form (FAILED - 12)

encodes/show
  renders attributes in <p> (FAILED - 13)

Failures:

  1) EncodesController GET #index returns a success response
     Failure/Error:
       raise WrongScopeError,
             "`#{name}` is not available from within an example (e.g. an " \
             "`it` block) or from constructs that run in the scope of an " \
             "example (e.g. `before`, `let`, etc). It is only available " \
             "on an example group (e.g. a `describe` or `context` block)."
     
       `name` is not available from within an example (e.g. an `it` block) or from constructs that run in the scope of an example (e.g. `before`, `let`, etc). It is only available on an example group (e.g. a `describe` or `context` block).

The bundle currently has mimemagic locked at 0.3.5.

Step 10/16 : RUN bundle install
---> Running in 578d62fab6ac
Fetching gem metadata from https://rubygems.org/............
You have requested:
 mimemagic ~> 0.4.1
The bundle currently has mimemagic locked at 0.3.5.
Try running `bundle update mimemagic`
If you are updating multiple gems in your Gemfile at once,
try passing them all to `bundle update`
ERROR: Service 'web' failed to build: The command '/bin/sh -c bundle install' returned a non-zero code: 7
The command "docker-compose build" failed and exited with 1 during .
Your build has been stopped.

Profile option

ActiveRecord::StatementInvalid: PG::ConnectionBad: PQconsumeInput() server closed the connection unexpectedly

2020-11-13T04:45:45.126Z pid=1 tid=grcr7pbzl class=EncodeWorker jid=820388786b0e5ae0b6041902 elapsed=1951.914 INFO: fail
2020-11-13T04:45:45.126Z pid=1 tid=grcr7pbzl WARN: {"context":"Job raised exception","job":{"retry":false,"queue":"default","backtrace":true,"class":"EncodeWorker","args":[71],"jid":"820388786b0e5ae0b6041902","created_at":1605240793.208652,"enqueued_at":1605240793.208673},"jobstr":"{\"retry\":false,\"queue\":\"default\",\"backtrace\":true,\"class\":\"EncodeWorker\",\"args\":[71],\"jid\":\"820388786b0e5ae0b6041902\",\"created_at\":1605240793.208652,\"enqueued_at\":1605240793.208673}"}
2020-11-13T04:45:45.126Z pid=1 tid=grcr7pbzl WARN: ActiveRecord::StatementInvalid: PG::ConnectionBad: PQconsumeInput() server closed the connection unexpectedly
	This probably means the server terminated abnormally
	before or while processing the request.

2020-11-13T04:45:45.126Z pid=1 tid=grcr7pbzl WARN: /usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/postgresql/database_statements.rb:92:in `exec'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/postgresql/database_statements.rb:92:in `block (2 levels) in execute'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/dependencies/interlock.rb:48:in `block in permit_concurrent_loads'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/concurrency/share_lock.rb:187:in `yield_shares'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/dependencies/interlock.rb:47:in `permit_concurrent_loads'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/postgresql/database_statements.rb:91:in `block in execute'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract_adapter.rb:722:in `block (2 levels) in log'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/concurrency/load_interlock_aware_monitor.rb:26:in `block (2 levels) in synchronize'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in `handle_interrupt'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in `block in synchronize'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in `handle_interrupt'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in `synchronize'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract_adapter.rb:721:in `block in log'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/notifications/instrumenter.rb:24:in `instrument'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract_adapter.rb:712:in `log'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/postgresql/database_statements.rb:90:in `execute'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/postgresql/database_statements.rb:150:in `begin_db_transaction'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/transaction.rb:179:in `materialize!'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/transaction.rb:246:in `block (2 levels) in materialize_transactions'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/transaction.rb:246:in `each'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/transaction.rb:246:in `block in materialize_transactions'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/concurrency/load_interlock_aware_monitor.rb:26:in `block (2 levels) in synchronize'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in `handle_interrupt'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in `block in synchronize'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in `handle_interrupt'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in `synchronize'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/transaction.rb:243:in `materialize_transactions'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/database_statements.rb:288:in `materialize_transactions'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/postgresql_adapter.rb:666:in `exec_no_cache'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/postgresql_adapter.rb:656:in `execute_and_clear'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/postgresql/database_statements.rb:111:in `exec_delete'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/database_statements.rb:174:in `update'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/query_cache.rb:22:in `update'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/persistence.rb:385:in `_update_record'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/persistence.rb:896:in `_update_row'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/locking/optimistic.rb:79:in `_update_row'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/persistence.rb:918:in `_update_record'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/attribute_methods/dirty.rb:205:in `_update_record'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/callbacks.rb:335:in `block in _update_record'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/callbacks.rb:135:in `run_callbacks'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/callbacks.rb:825:in `_run_update_callbacks'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/callbacks.rb:335:in `_update_record'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/timestamp.rb:123:in `_update_record'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/persistence.rb:905:in `create_or_update'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/callbacks.rb:327:in `block in create_or_update'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/callbacks.rb:135:in `run_callbacks'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/callbacks.rb:825:in `_run_save_callbacks'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/callbacks.rb:327:in `create_or_update'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/timestamp.rb:128:in `create_or_update'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/persistence.rb:470:in `save'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/validations.rb:47:in `save'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/transactions.rb:314:in `block in save'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/transactions.rb:375:in `block in with_transaction_returning_status'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/database_statements.rb:278:in `transaction'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/transactions.rb:212:in `transaction'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/transactions.rb:366:in `with_transaction_returning_status'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/transactions.rb:314:in `save'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/suppressor.rb:44:in `save'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/persistence.rb:621:in `block in update'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/transactions.rb:375:in `block in with_transaction_returning_status'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/database_statements.rb:280:in `block in transaction'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/transaction.rb:280:in `block in within_new_transaction'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/concurrency/load_interlock_aware_monitor.rb:26:in `block (2 levels) in synchronize'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in `handle_interrupt'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in `block in synchronize'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in `handle_interrupt'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in `synchronize'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/transaction.rb:278:in `within_new_transaction'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/connection_adapters/abstract/database_statements.rb:280:in `transaction'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/transactions.rb:212:in `transaction'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/transactions.rb:366:in `with_transaction_returning_status'
/usr/local/bundle/ruby/2.6.0/gems/activerecord-6.0.3.2/lib/active_record/persistence.rb:619:in `update'
/myapp/app/workers/encode_worker.rb:66:in `block in perform'
/usr/local/bundle/ruby/2.6.0/gems/activestorage-6.0.3.2/lib/active_storage/downloader.rb:15:in `block in open'
/usr/local/bundle/ruby/2.6.0/gems/activestorage-6.0.3.2/lib/active_storage/downloader.rb:24:in `open_tempfile'
/usr/local/bundle/ruby/2.6.0/gems/activestorage-6.0.3.2/lib/active_storage/downloader.rb:12:in `open'
/usr/local/bundle/ruby/2.6.0/gems/activestorage-6.0.3.2/lib/active_storage/service.rb:86:in `open'
/usr/local/bundle/ruby/2.6.0/gems/activestorage-6.0.3.2/app/models/active_storage/blob.rb:219:in `open'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/core_ext/module/delegation.rb:304:in `public_send'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/core_ext/module/delegation.rb:304:in `method_missing'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/core_ext/module/delegation.rb:304:in `public_send'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/core_ext/module/delegation.rb:304:in `method_missing'
/myapp/app/workers/encode_worker.rb:9:in `perform'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:196:in `execute_job'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:164:in `block (2 levels) in process'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/middleware/chain.rb:133:in `invoke'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:163:in `block in process'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:136:in `block (6 levels) in dispatch'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/job_retry.rb:111:in `local'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:135:in `block (5 levels) in dispatch'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/rails.rb:14:in `block in call'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/execution_wrapper.rb:88:in `wrap'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/reloader.rb:72:in `block in wrap'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/execution_wrapper.rb:88:in `wrap'
/usr/local/bundle/ruby/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/reloader.rb:71:in `wrap'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/rails.rb:13:in `call'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:131:in `block (4 levels) in dispatch'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:257:in `stats'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:126:in `block (3 levels) in dispatch'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/job_logger.rb:13:in `call'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:125:in `block (2 levels) in dispatch'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/job_retry.rb:78:in `global'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:124:in `block in dispatch'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/logger.rb:10:in `with'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/job_logger.rb:33:in `prepare'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:123:in `dispatch'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:162:in `process'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:78:in `process_one'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:68:in `run'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:15:in `watchdog'
/usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:24:in `block in safe_thread'

404 http status code from Active Storage Direct upload

large file(more than 1Gbyte) for direct upload take many time.
if upload take 10min or more. i got 404 put error message from direct upload http response.
because mattr_accessor :service_urls_expire_in, default: 5.minutes
https://github.com/rails/rails/blob/master/activestorage/lib/active_storage.rb#L61-L61

Errno::ENOSPC: No space left on device @ io_write - /tmp/ActiveStorage-732-20201114-1-rxd9zz.mp4

when i use docker-machine with aws driver for clustering.
there is not enough disk space in worker node due to many docker images or if i upload video file with big size of above 2Gbyte.

Errno::ENOSPC: No space left on device @ io_write - /tmp/ActiveStorage-732-20201114-1-rxd9zz.mp4

N+1 problem when loading encode.file encode.thumbnail

I got slow loading at /encodes index page

encode per page number is 20.
encode has a attached file.
encode has one more attached thumbnails.

has_one_attached :file
has_many_attached :thumbnails

and below log show me that page loading time is 659ms

web_1      | Started GET "/encodes" for 172.21.0.1 at 2020-08-01 00:26:44 +0000
web_1      | Cannot render console from 172.21.0.1! Allowed networks: 127.0.0.0/127.255.255.255, ::1
web_1      | Processing by EncodesController#index as HTML
web_1      |   User Load (0.6ms)  SELECT "users".* FROM "users" WHERE "users"."id" = $1 ORDER BY "users"."id" ASC LIMIT $2  [["id", 1], ["LIMIT", 1]]
web_1      |   Rendering encodes/index.html.erb within layouts/application
web_1      |   Encode Load (3.0ms)  SELECT "encodes".* FROM "encodes" WHERE "encodes"."published" = $1 ORDER BY id DESC LIMIT $2 OFFSET $3  [["published", true], ["LIMIT", 20], ["OFFSET", 0]]
web_1      |   ↳ app/views/encodes/index.html.erb:17
web_1      |   ActiveStorage::Attachment Load (0.7ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 LIMIT $4  [["record_id", 167], ["record_type", "Encode"], ["name", "file"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Blob Load (0.7ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 441], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Attachment Load (0.7ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 167], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:27
web_1      |   CACHE ActiveStorage::Attachment Load (0.0ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 167], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Blob Load (0.7ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 442], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Attachment Load (0.6ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 LIMIT $4  [["record_id", 166], ["record_type", "Encode"], ["name", "file"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Blob Load (0.6ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 434], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Attachment Load (0.8ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 166], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:27
web_1      |   CACHE ActiveStorage::Attachment Load (0.0ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 166], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Blob Load (0.6ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 435], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Attachment Load (0.5ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 LIMIT $4  [["record_id", 165], ["record_type", "Encode"], ["name", "file"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Blob Load (0.5ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 427], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Attachment Load (0.5ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 165], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:27
web_1      |   CACHE ActiveStorage::Attachment Load (0.0ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 165], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Blob Load (0.6ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 428], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Attachment Load (0.6ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 LIMIT $4  [["record_id", 164], ["record_type", "Encode"], ["name", "file"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Blob Load (0.6ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 420], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Attachment Load (0.6ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 164], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:27
web_1      |   CACHE ActiveStorage::Attachment Load (0.0ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 164], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Blob Load (0.7ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 421], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Attachment Load (1.0ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 LIMIT $4  [["record_id", 163], ["record_type", "Encode"], ["name", "file"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Blob Load (0.6ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 413], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Attachment Load (0.7ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 163], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:27
web_1      |   CACHE ActiveStorage::Attachment Load (0.0ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 163], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Blob Load (0.5ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 414], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Attachment Load (0.9ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 LIMIT $4  [["record_id", 162], ["record_type", "Encode"], ["name", "file"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      | Started GET "/cable" for 172.21.0.1 at 2020-08-01 00:26:45 +0000
web_1      |   ActiveStorage::Blob Load (0.9ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 406], ["LIMIT", 1]]
web_1      | Cannot render console from 172.21.0.1! Allowed networks: 127.0.0.0/127.255.255.255, ::1
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Attachment Load (0.8ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 162], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:27
web_1      |   CACHE ActiveStorage::Attachment Load (0.0ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 162], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Blob Load (0.6ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 407], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      | Started GET "/cable/" [WebSocket] for 172.21.0.1 at 2020-08-01 00:26:45 +0000
web_1      |   ActiveStorage::Attachment Load (0.9ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 LIMIT $4  [["record_id", 161], ["record_type", "Encode"], ["name", "file"], ["LIMIT", 1]]
web_1      | Successfully upgraded to WebSocket (REQUEST_METHOD: GET, HTTP_CONNECTION: Upgrade, HTTP_UPGRADE: websocket)
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Blob Load (0.8ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 399], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   User Load (5.8ms)  SELECT "users".* FROM "users" WHERE "users"."id" = $1 ORDER BY "users"."id" ASC LIMIT $2  [["id", 1], ["LIMIT", 1]]
web_1      |   ActiveStorage::Attachment Load (1.2ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 161], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/channels/application_cable/connection.rb:13:in `find_verified_user'
web_1      | [ActionCable] [1] Registered connection (Z2lkOi8vY3ctb3ZwL1VzZXIvMQ)
web_1      |   ↳ app/views/encodes/index.html.erb:27
web_1      |   CACHE ActiveStorage::Attachment Load (0.0ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 161], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      | [ActionCable] [1] EncodeChannel is transmitting the subscription confirmation
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Blob Load (0.8ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 400], ["LIMIT", 1]]
web_1      | [ActionCable] [1] EncodeChannel is streaming from encode_channel
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Attachment Load (0.9ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 LIMIT $4  [["record_id", 160], ["record_type", "Encode"], ["name", "file"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Blob Load (0.5ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 392], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Attachment Load (0.8ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 160], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:27
web_1      |   CACHE ActiveStorage::Attachment Load (0.1ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 160], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Blob Load (1.6ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 393], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Attachment Load (0.8ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 LIMIT $4  [["record_id", 159], ["record_type", "Encode"], ["name", "file"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Blob Load (1.0ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 391], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Attachment Load (0.7ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 159], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:27
web_1      |   ActiveStorage::Attachment Load (0.5ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 LIMIT $4  [["record_id", 158], ["record_type", "Encode"], ["name", "file"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Blob Load (0.7ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 384], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Attachment Load (2.2ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 158], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:27
web_1      |   CACHE ActiveStorage::Attachment Load (0.0ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 158], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Blob Load (0.7ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 385], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Attachment Load (0.9ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 LIMIT $4  [["record_id", 157], ["record_type", "Encode"], ["name", "file"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Blob Load (0.6ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 377], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Attachment Load (0.6ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 157], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:27
web_1      |   CACHE ActiveStorage::Attachment Load (0.0ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 157], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Blob Load (0.6ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 378], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Attachment Load (1.9ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 LIMIT $4  [["record_id", 156], ["record_type", "Encode"], ["name", "file"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Blob Load (0.5ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 370], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Attachment Load (0.6ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 156], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:27
web_1      |   CACHE ActiveStorage::Attachment Load (0.0ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 156], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Blob Load (0.7ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 371], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Attachment Load (0.6ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 LIMIT $4  [["record_id", 155], ["record_type", "Encode"], ["name", "file"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Blob Load (0.7ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 364], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Attachment Load (0.6ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 155], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:27
web_1      |   CACHE ActiveStorage::Attachment Load (0.0ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 155], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Blob Load (0.8ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 365], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Attachment Load (0.6ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 LIMIT $4  [["record_id", 154], ["record_type", "Encode"], ["name", "file"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Blob Load (0.9ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 358], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Attachment Load (0.8ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 154], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:27
web_1      |   CACHE ActiveStorage::Attachment Load (0.0ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 154], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Blob Load (0.7ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 359], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Attachment Load (0.6ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 LIMIT $4  [["record_id", 153], ["record_type", "Encode"], ["name", "file"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Blob Load (0.6ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 352], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Attachment Load (0.5ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 153], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:27
web_1      |   CACHE ActiveStorage::Attachment Load (0.0ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 153], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Blob Load (0.9ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 353], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Attachment Load (0.9ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 LIMIT $4  [["record_id", 152], ["record_type", "Encode"], ["name", "file"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Blob Load (0.6ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 346], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Attachment Load (0.6ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 152], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:27
web_1      |   CACHE ActiveStorage::Attachment Load (0.0ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 152], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Blob Load (0.7ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 347], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Attachment Load (0.6ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 LIMIT $4  [["record_id", 151], ["record_type", "Encode"], ["name", "file"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Blob Load (0.8ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 340], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Attachment Load (0.6ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 151], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:27
web_1      |   CACHE ActiveStorage::Attachment Load (0.0ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 151], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Blob Load (0.7ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 341], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Attachment Load (0.7ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 LIMIT $4  [["record_id", 150], ["record_type", "Encode"], ["name", "file"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Blob Load (1.0ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 337], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Attachment Load (0.6ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 150], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:27
web_1      |   CACHE ActiveStorage::Attachment Load (0.0ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 150], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Blob Load (0.7ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 338], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Attachment Load (0.6ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 LIMIT $4  [["record_id", 149], ["record_type", "Encode"], ["name", "file"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Blob Load (0.6ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 331], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Attachment Load (0.6ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 149], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:27
web_1      |   CACHE ActiveStorage::Attachment Load (0.0ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 149], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Blob Load (0.6ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 332], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Attachment Load (0.6ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 LIMIT $4  [["record_id", 148], ["record_type", "Encode"], ["name", "file"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Blob Load (0.9ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 329], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:21
web_1      |   ActiveStorage::Attachment Load (0.5ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 148], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:27
web_1      |   CACHE ActiveStorage::Attachment Load (0.0ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_id" = $1 AND "active_storage_attachments"."record_type" = $2 AND "active_storage_attachments"."name" = $3 ORDER BY "active_storage_attachments"."id" ASC LIMIT $4  [["record_id", 148], ["record_type", "Encode"], ["name", "thumbnails"], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |   ActiveStorage::Blob Load (0.5ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" = $1 LIMIT $2  [["id", 330], ["LIMIT", 1]]
web_1      |   ↳ app/views/encodes/index.html.erb:29
web_1      |    (3.0ms)  SELECT COUNT(*) FROM "encodes" WHERE "encodes"."published" = $1  [["published", true]]
web_1      |   ↳ app/views/encodes/index.html.erb:37
web_1      |   Rendered encodes/index.html.erb within layouts/application (Duration: 510.8ms | Allocations: 104874)
web_1      | [Webpacker] Everything's up-to-date. Nothing to do
web_1      |   Rendered layouts/_header.erb (Duration: 11.8ms | Allocations: 705)
web_1      |   Rendered layouts/_menu.erb (Duration: 0.5ms | Allocations: 208)
web_1      | Completed 200 OK in 659ms (Views: 588.8ms | ActiveRecord: 65.6ms | Allocations: 112020)

The bundle currently has rails locked at 6.0.4.1.

i got error message when update rails 6.0 to 6.1

 % docker-compose --env-file .env.dev.s3 up --build -d
Creating network "cw-ovp_cw_ovp_network" with driver "bridge"
Building web
[+] Building 104.7s (14/18)                                                                                                                                                                                 
 => [internal] load build definition from Dockerfile                                                                                                                                                   0.0s
 => => transferring dockerfile: 37B                                                                                                                                                                    0.0s
 => [internal] load .dockerignore                                                                                                                                                                      0.0s
 => => transferring context: 34B                                                                                                                                                                       0.0s
 => [internal] load metadata for docker.io/library/ruby:2.6.3                                                                                                                                          0.0s
 => [ 1/14] FROM docker.io/library/ruby:2.6.3                                                                                                                                                          0.0s
 => [internal] load build context                                                                                                                                                                     47.4s
 => => transferring context: 1.50GB                                                                                                                                                                   47.0s
 => CACHED [ 2/14] RUN curl -sL https://deb.nodesource.com/setup_16.x | bash - &&     curl -sS https://dl.yarnpkg.com/debian/pubkey.gpg | apt-key add - &&     echo "deb https://dl.yarnpkg.com/debia  0.0s
 => CACHED [ 3/14] RUN apt-get update &&     apt-get install -y         python3         python3-pip         python3-setuptools         groff         less     && pip3 install --upgrade pip     && ap  0.0s
 => CACHED [ 4/14] RUN pip3 --no-cache-dir install --upgrade awscli                                                                                                                                    0.0s
 => CACHED [ 5/14] RUN mkdir /myapp                                                                                                                                                                    0.0s
 => CACHED [ 6/14] RUN mkdir /storage                                                                                                                                                                  0.0s
 => CACHED [ 7/14] WORKDIR /myapp                                                                                                                                                                      0.0s
 => [ 8/14] COPY . /myapp                                                                                                                                                                             43.8s
 => [ 9/14] RUN gem update --system                                                                                                                                                                    7.1s
 => ERROR [10/14] RUN bundle install                                                                                                                                                                   6.2s 
------                                                                                                                                                                                                      
 > [10/14] RUN bundle install:                                                                                                                                                                              
#14 2.947 Fetching gem metadata from https://rubygems.org/............                                                                                                                                      
#14 6.073 You have requested:                                                                                                                                                                               
#14 6.073   rails ~> 6.1, >= 6.1.4.1                                                                                                                                                                        
#14 6.073 
#14 6.073 The bundle currently has rails locked at 6.0.4.1.
#14 6.073 Try running `bundle update rails`
#14 6.073 
#14 6.073 If you are updating multiple gems in your Gemfile at once,
#14 6.073 try passing them all to `bundle update`
------
executor failed running [/bin/sh -c bundle install]: exit code: 7
ERROR: Service 'web' failed to build : Build failed

/api/v1/video/assets

Added /api/v1/video/assets
1. POST /api/v1/video/assets
2. GET /api/v1/video/assets?q=[SEARCH_KEYWORD]
3. GET /api/v1/video/assets/[ASSET_ID]
4. DELETE /api/v1/video/assets/[ASSET_ID]
apikey column in User model
validation apikey when using /api/v1/video/assets

temp path not deleted

there is remain of path for saved packaging file after ffmpeg encoding and packaging and s3 mv script running.
i must delete temp path for clean code and managing local storage after above of script job.

"percentage"=>"-Inf%"

I got total file number from first line with matched_time = line.to_s.match(/Completed \d+.\d+ \w+\/\d+.\d+ \w+ \(\d+.\d+ \w+\/s\) with (\d+) file\(s\) remaining/)

but first line there is ~75 file and ~490. above of code can't working well for extracing total file number
than i got INF value. this is invalid value.

Completed 256.0 KiB/~162.5 MiB (314.6 KiB/s) with ~75 file(s) remaining (calculating...)
Completed 11.4 MiB/~530.5 MiB (1.5 MiB/s) with ~490 file(s) remaining (calculating...)
Completed 12.9 MiB/709.0 MiB (1.5 MiB/s) with 640 file(s) remaining

web_1      | [ActionCable] [1] EncodeChannel transmitting {"event"=>"HLS_PROCESSING", "body"=>{"percentage"=>"-Inf%", "log"=>"Completed 12.9 MiB/709.0 MiB (1.5 MiB/s) with 640 file(s) remaining\n", "filename"=>nil, "thumbnail_url"=>nil, "encode"=>{"id"=>251, "runtime"=>"00:10:34.53\n", "user_id"=>1, "title"=>"bbb sunflower 1080p 30fps", "log"=>nil, "sta... (via streamed from encode_channel)

VIdeo packaging job unit testing

build error on apple silicon m1

 % docker-compose build
[+] Building 10.8s (10/33)                                                                                                                                                                                                                           
 => [cw-ovp_sidekiq internal] load build definition from Dockerfile                                                                                                                                                                             0.0s
 => => transferring dockerfile: 1.21kB                                                                                                                                                                                                          0.0s
 => [cw-ovp_web internal] load build definition from Dockerfile                                                                                                                                                                                 0.0s
 => => transferring dockerfile: 1.21kB                                                                                                                                                                                                          0.0s
 => [cw-ovp_sidekiq internal] load .dockerignore                                                                                                                                                                                                0.0s
 => => transferring context: 34B                                                                                                                                                                                                                0.0s
 => [cw-ovp_web internal] load .dockerignore                                                                                                                                                                                                    0.0s
 => => transferring context: 34B                                                                                                                                                                                                                0.0s
 => [cw-ovp_web internal] load metadata for docker.io/library/ruby:2.6.3                                                                                                                                                                        0.4s
 => [cw-ovp_web internal] load build context                                                                                                                                                                                                    0.1s
 => => transferring context: 265.43kB                                                                                                                                                                                                           0.1s
 => CACHED [cw-ovp_web  1/19] FROM docker.io/library/ruby:2.6.3@sha256:358f16e92d0f66599103318f7a8528d449b0973fd89e46a1a5c47cec7479f09b                                                                                                         0.0s
 => [cw-ovp_sidekiq internal] load build context                                                                                                                                                                                                0.1s
 => => transferring context: 265.43kB                                                                                                                                                                                                           0.1s
 => [cw-ovp_web  2/19] RUN curl -sL https://deb.nodesource.com/setup_16.x | bash -                                                                                                                                                              4.8s
 => ERROR [cw-ovp_sidekiq  3/19] RUN curl -sS https://dl.yarnpkg.com/debian/pubkey.gpg | apt-key add -                                                                                                                                          5.5s
------                                                                                                                                                                                                                                               
 > [cw-ovp_sidekiq  3/19] RUN curl -sS https://dl.yarnpkg.com/debian/pubkey.gpg | apt-key add -:                                                                                                                                                     
#8 0.222 Warning: apt-key output should not be parsed (stdout is not a terminal)                                                                                                                                                                     
#8 0.255 Warning: apt-key output should not be parsed (stdout is not a terminal)                                                                                                                                                                     
#8 5.465 gpg: no valid OpenPGP data found.                                                                                                                                                                                                           
#8 5.466 Segmentation fault
#8 5.498 gpg: no valid OpenPGP data found.
#8 5.500 Segmentation fault
------
failed to solve: rpc error: code = Unknown desc = executor failed running [/bin/sh -c curl -sS https://dl.yarnpkg.com/debian/pubkey.gpg | apt-key add -]: exit code: 2

How can I deploy CW-OVP for update source code? - I need jenkins

sometime i rebuild and deploy CW-OVP on production environment with docker swarm mode.
i have confuse due to when i run bash commands that has many commands.
i need such as jenkins with deploy bash script.

ActionView::Template::Error undefined method service_name

web_1      | ActionView::Template::Error (undefined method `service_name' for #<ActiveStorage::Blob:0x00007fdc02de2e08>):
web_1      |     19:     </tr>
web_1      |     20:     </thead>
web_1      |     21:     <tbody>
web_1      |     22:     <% @encodes.each do |encode| %>
web_1      |     23:       <tr id="encode_id" data-encode-id="<%= encode.id %>">
web_1      |     24:         <th><%= encode.id %></th>
web_1      |     25:         <td><%= encode.title %></td>
web_1      |   
web_1      | app/views/encodes/index.html.erb:22
web_1      | Started GET "/encodes?page=2" for 172.19.0.1 at 2021-08-26 05:23:26 +0000
web_1      | Cannot render console from 172.19.0.1! Allowed networks: 127.0.0.0/127.255.255.255, ::1
web_1      | Processing by EncodesController#index as HTML
web_1      |   Parameters: {"page"=>"2"}
web_1      |   User Load (0.6ms)  SELECT "users".* FROM "users" WHERE "users"."id" = $1 ORDER BY "users"."id" ASC LIMIT $2  [["id", 1], ["LIMIT", 1]]
web_1      |   Rendering layout layouts/application.html.erb
web_1      |   Rendering encodes/index.html.erb within layouts/application
web_1      |   Encode Load (2.1ms)  SELECT "encodes".* FROM "encodes" WHERE "encodes"."published" = $1 ORDER BY id DESC LIMIT $2 OFFSET $3  [["published", true], ["LIMIT", 20], ["OFFSET", 20]]
web_1      |   ↳ app/views/encodes/index.html.erb:22
web_1      |   ActiveStorage::Attachment Load (0.8ms)  SELECT "active_storage_attachments".* FROM "active_storage_attachments" WHERE "active_storage_attachments"."record_type" = $1 AND "active_storage_attachments"."name" = $2 AND "active_storage_attachments"."record_id" IN ($3, $4, $5, $6, $7, $8, $9, $10, $11, $12, $13, $14, $15, $16, $17, $18, $19, $20, $21, $22)  [["record_type", "Encode"], ["name", "file"], ["record_id", 320], ["record_id", 319], ["record_id", 318], ["record_id", 317], ["record_id", 316], ["record_id", 315], ["record_id", 314], ["record_id", 313], ["record_id", 312], ["record_id", 311], ["record_id", 310], ["record_id", 309], ["record_id", 308], ["record_id", 307], ["record_id", 306], ["record_id", 305], ["record_id", 304], ["record_id", 303], ["record_id", 302], ["record_id", 301]]
web_1      |   ↳ app/views/encodes/index.html.erb:22
web_1      |   ActiveStorage::Blob Load (0.7ms)  SELECT "active_storage_blobs".* FROM "active_storage_blobs" WHERE "active_storage_blobs"."id" IN ($1, $2, $3, $4, $5, $6, $7, $8, $9, $10, $11, $12, $13, $14, $15, $16, $17, $18, $19, $20)  [["id", 2681], ["id", 2692], ["id", 2703], ["id", 2714], ["id", 2725], ["id", 2737], ["id", 2738], ["id", 2749], ["id", 2760], ["id", 2771], ["id", 2781], ["id", 2786], ["id", 2793], ["id", 2815], ["id", 2826], ["id", 2834], ["id", 2848], ["id", 2859], ["id", 2870], ["id", 2881]]
web_1      |   ↳ app/views/encodes/index.html.erb:22
web_1      |   Rendered encodes/index.html.erb within layouts/application (Duration: 17.7ms | Allocations: 5023)
web_1      |   Rendered layout layouts/application.html.erb (Duration: 20.2ms | Allocations: 5094)
web_1      | Completed 500 Internal Server Error in 29ms (ActiveRecord: 4.2ms | Allocations: 6795)
web_1      | 
web_1      | 
web_1      |   
web_1      | ActionView::Template::Error (undefined method `service_name' for #<ActiveStorage::Blob:0x00007fdc02f4ba88>):
web_1      |     19:     </tr>
web_1      |     20:     </thead>
web_1      |     21:     <tbody>
web_1      |     22:     <% @encodes.each do |encode| %>
web_1      |     23:       <tr id="encode_id" data-encode-id="<%= encode.id %>">
web_1      |     24:         <th><%= encode.id %></th>
web_1      |     25:         <td><%= encode.title %></td>
web_1      |   
web_1      | app/views/encodes/index.html.erb:22

[docker-stack.yml] "invalid mount config for type "bind": bind source path does not exist: /home/docker/CW-OVP"

i did complete docker-stack.yml for docker swarm
but i got volume problem. there can't bind volume

docker@master:~/CW-OVP$ docker service ps --no-trunc t9zabkgynr8c                                                                                                                                         
ID                          NAME                IMAGE                                                                                                  NODE                DESIRED STATE       CURRENT STATE             ERROR                                                                                          PORTS
z58bv862nychmdnrazwk153xz   CW-OVP_web.1        127.0.0.1:5000/cw-ovp:latest@sha256:4315281921abea8f097bd5ce8a12c3827f6c9a1c857ef82fcf78dc4646099526   worker2             Ready               Rejected 1 second ago     "invalid mount config for type "bind": bind source path does not exist: /home/docker/CW-OVP"   
nwa44kwxfn2oki9dldyk2270g    \_ CW-OVP_web.1    127.0.0.1:5000/cw-ovp:latest@sha256:4315281921abea8f097bd5ce8a12c3827f6c9a1c857ef82fcf78dc4646099526   worker2             Shutdown            Rejected 6 seconds ago    "invalid mount config for type "bind": bind source path does not exist: /home/docker/CW-OVP"   
infz5rqcdwqwgrtqikl1m6vdv    \_ CW-OVP_web.1    127.0.0.1:5000/cw-ovp:latest@sha256:4315281921abea8f097bd5ce8a12c3827f6c9a1c857ef82fcf78dc4646099526   worker2             Shutdown            Rejected 11 seconds ago   "invalid mount config for type "bind": bind source path does not exist: /home/docker/CW-OVP"   
z7x4f2st1z7agx4a6rk3tjexe    \_ CW-OVP_web.1    127.0.0.1:5000/cw-ovp:latest@sha256:4315281921abea8f097bd5ce8a12c3827f6c9a1c857ef82fcf78dc4646099526   worker1             Shutdown            Rejected 16 seconds ago   "invalid mount config for type "bind": bind source path does not exist: /home/docker/CW-OVP"   
6x2p8iag5mswa772k2o9tcz93    \_ CW-OVP_web.1    127.0.0.1:5000/cw-ovp:latest@sha256:4315281921abea8f097bd5ce8a12c3827f6c9a1c857ef82fcf78dc4646099526   worker2             Shutdown            Rejected 21 seconds ago   "invalid mount config for type "bind": bind source path does not exist: /home/docker/CW-OVP"   
cg7j7474429riye3ap7nxhvr3   CW-OVP_web.2        127.0.0.1:5000/cw-ovp:latest@sha256:4315281921abea8f097bd5ce8a12c3827f6c9a1c857ef82fcf78dc4646099526   worker1             Ready               Rejected 1 second ago     "invalid mount config for type "bind": bind source path does not exist: /home/docker/CW-OVP"   
wplt3suqd32a7lupjac8ln4fj    \_ CW-OVP_web.2    127.0.0.1:5000/cw-ovp:latest@sha256:4315281921abea8f097bd5ce8a12c3827f6c9a1c857ef82fcf78dc4646099526   worker1             Shutdown            Rejected 6 seconds ago    "invalid mount config for type "bind": bind source path does not exist: /home/docker/CW-OVP"   
ejidxknmkp8hymgmqz8475j9w    \_ CW-OVP_web.2    127.0.0.1:5000/cw-ovp:latest@sha256:4315281921abea8f097bd5ce8a12c3827f6c9a1c857ef82fcf78dc4646099526   worker1             Shutdown            Rejected 11 seconds ago   "invalid mount config for type "bind": bind source path does not exist: /home/docker/CW-OVP"   
gk7eziq1zlnvtddgpz8hwljpb    \_ CW-OVP_web.2    127.0.0.1:5000/cw-ovp:latest@sha256:4315281921abea8f097bd5ce8a12c3827f6c9a1c857ef82fcf78dc4646099526   worker2             Shutdown            Rejected 16 seconds ago   "invalid mount config for type "bind": bind source path does not exist: /home/docker/CW-OVP"   
qvj0a23gbf9v8ooucj2td465p    \_ CW-OVP_web.2    127.0.0.1:5000/cw-ovp:latest@sha256:4315281921abea8f097bd5ce8a12c3827f6c9a1c857ef82fcf78dc4646099526   worker1             Shutdown            Rejected 21 seconds ago   "invalid mount config for type "bind": bind source path does not exist: /home/docker/CW-OVP"

encoding not working on multiple node

I got crash error when multiple node
worker can't find uploaded file that stored in local server
I have to change local file path to NFS or symbolic link or S3 such as block storage for sharing between multiple server

19:12:07 job.1    | 2020-07-16T02:12:07.067Z pid=74563 tid=ov9pcqcsv class=EncodeWorker jid=2393fed14ccf25494ff38e53 INFO: start
19:12:07 job.1    | 2020-07-16T02:12:07.073Z pid=74563 tid=ov9pcqcsv class=EncodeWorker jid=2393fed14ccf25494ff38e53 elapsed=0.006 INFO: fail
19:12:07 job.1    | 2020-07-16T02:12:07.074Z pid=74563 tid=ov9pcqcsv WARN: {"context":"Job raised exception","job":{"retry":true,"queue":"default","class":"EncodeWorker","args":["#<Encode:0x00007fba94acb858>"],"jid":"2393fed14ccf25494ff38e53","created_at":1594845654.705516,"enqueued_at":1594865527.0652952,"error_message":"wrong number of arguments (given 1, expected 2)","error_class":"ArgumentError","failed_at":1594845654.7858062,"retry_count":8,"retried_at":1594865527.0069911},"jobstr":"{\"retry\":true,\"queue\":\"default\",\"class\":\"EncodeWorker\",\"args\":[\"#<Encode:0x00007fba94acb858>\"],\"jid\":\"2393fed14ccf25494ff38e53\",\"created_at\":1594845654.705516,\"enqueued_at\":1594865527.0652952,\"error_message\":\"wrong number of arguments (given 1, expected 2)\",\"error_class\":\"ArgumentError\",\"failed_at\":1594845654.7858062,\"retry_count\":8,\"retried_at\":1594865527.0069911}"}
19:12:07 job.1    | 2020-07-16T02:12:07.074Z pid=74563 tid=ov9pcqcsv WARN: ArgumentError: wrong number of arguments (given 1, expected 2)
19:12:07 job.1    | 2020-07-16T02:12:07.074Z pid=74563 tid=ov9pcqcsv WARN: /Users/rhee/project/CW-OVP/app/workers/encode_worker.rb:5:in `perform'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:196:in `execute_job'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:164:in `block (2 levels) in process'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/middleware/chain.rb:133:in `invoke'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:163:in `block in process'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:136:in `block (6 levels) in dispatch'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/job_retry.rb:111:in `local'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:135:in `block (5 levels) in dispatch'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/rails.rb:14:in `block in call'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/execution_wrapper.rb:88:in `wrap'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/reloader.rb:72:in `block in wrap'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/execution_wrapper.rb:88:in `wrap'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/reloader.rb:71:in `wrap'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/rails.rb:13:in `call'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:131:in `block (4 levels) in dispatch'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:257:in `stats'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:126:in `block (3 levels) in dispatch'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/job_logger.rb:13:in `call'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:125:in `block (2 levels) in dispatch'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/job_retry.rb:78:in `global'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:124:in `block in dispatch'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/logger.rb:10:in `with'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/job_logger.rb:33:in `prepare'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:123:in `dispatch'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:162:in `process'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:78:in `process_one'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:68:in `run'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:15:in `watchdog'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:24:in `block in safe_thread'
19:12:07 job.1    | 2020-07-16T02:12:07.104Z pid=74563 tid=ov9pctlhf class=EncodeWorker jid=fb8161c1008dcb1d7cf638e4 INFO: start
19:12:07 job.1    | 2020-07-16T02:12:07.109Z pid=74563 tid=ov9pctlhf class=EncodeWorker jid=fb8161c1008dcb1d7cf638e4 elapsed=0.005 INFO: fail
19:12:07 job.1    | 2020-07-16T02:12:07.109Z pid=74563 tid=ov9pctlhf WARN: {"context":"Job raised exception","job":{"retry":true,"queue":"default","class":"EncodeWorker","args":["#<Encode:0x00007fba8f40f550>"],"jid":"fb8161c1008dcb1d7cf638e4","created_at":1594845983.1612182,"enqueued_at":1594865527.1025221,"error_message":"wrong number of arguments (given 1, expected 2)","error_class":"ArgumentError","failed_at":1594845983.2229362,"retry_count":8,"retried_at":1594865527.0920582},"jobstr":"{\"retry\":true,\"queue\":\"default\",\"class\":\"EncodeWorker\",\"args\":[\"#<Encode:0x00007fba8f40f550>\"],\"jid\":\"fb8161c1008dcb1d7cf638e4\",\"created_at\":1594845983.1612182,\"enqueued_at\":1594865527.1025221,\"error_message\":\"wrong number of arguments (given 1, expected 2)\",\"error_class\":\"ArgumentError\",\"failed_at\":1594845983.2229362,\"retry_count\":8,\"retried_at\":1594865527.0920582}"}
19:12:07 job.1    | 2020-07-16T02:12:07.109Z pid=74563 tid=ov9pctlhf WARN: ArgumentError: wrong number of arguments (given 1, expected 2)
19:12:07 job.1    | 2020-07-16T02:12:07.109Z pid=74563 tid=ov9pctlhf WARN: /Users/rhee/project/CW-OVP/app/workers/encode_worker.rb:5:in `perform'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:196:in `execute_job'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:164:in `block (2 levels) in process'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/middleware/chain.rb:133:in `invoke'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:163:in `block in process'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:136:in `block (6 levels) in dispatch'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/job_retry.rb:111:in `local'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:135:in `block (5 levels) in dispatch'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/rails.rb:14:in `block in call'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/execution_wrapper.rb:88:in `wrap'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/reloader.rb:72:in `block in wrap'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/execution_wrapper.rb:88:in `wrap'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/activesupport-6.0.3.2/lib/active_support/reloader.rb:71:in `wrap'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/rails.rb:13:in `call'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:131:in `block (4 levels) in dispatch'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:257:in `stats'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:126:in `block (3 levels) in dispatch'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/job_logger.rb:13:in `call'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:125:in `block (2 levels) in dispatch'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/job_retry.rb:78:in `global'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:124:in `block in dispatch'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/logger.rb:10:in `with'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/job_logger.rb:33:in `prepare'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:123:in `dispatch'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:162:in `process'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:78:in `process_one'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:68:in `run'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:15:in `watchdog'
19:12:07 job.1    | /Users/rhee/.rbenv/versions/2.6.3/lib/ruby/gems/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:24:in `block in safe_thread'

speed up docker build

https://dev.to/reiz/how-to-speed-up-your-daily-docker-builds-pkp
https://fe-developers.kakaoent.com/2022/220414-docker-cache/?fbclid=IwAR0W1LKPEq3bjXV6f_Fpl1P9uw8DxT0NY9VBr0Df6YWzUkochzkyaT20eaE

Dockerfile

before

RUN gem update --system
RUN bundle check || bundle install --jobs 4
RUN yarn install --check-files

after

RUN gem update --system \
    && bundle check || bundle install --jobs 4 \
    && yarn install --check-files

webpacker on docker-compose

  webpacker:
    <<: *app_base
    command: ./bin/webpack-dev-server < echo 'y'
    env_file:
      - .env.dev.docker.compose
      - .env.dev.s3
    volumes:
      - .:/myapp
    environment:
      RAILS_ENV: development
      NODE_ENV: development
      WEBPACKER_DEV_SERVER_HOST: 0.0.0.0
    tty: false
    stdin_open: false
    ports:
      - '3035:3035'

and there is compatibility issue rails/rails#43062

clustering with docker-machine

when deployed in production we have to use cluster for performance.
docker-machine support aws drive and docker swarm.
i choose docker swarm for clustering. it easy and fast.
i need only docker-stack.yml.
https://github.com/x1wins/CW-OVP/blob/master/docker-stack.yml

below of there is just command for deploy.

docker stack deploy --compose-file docker-stack.yml CW-OVP

Include aws s3 copy job in Total Percentage

this of below is aws s3 copy of log

Completed 11.1 MiB/662.3 MiB (2.0 MiB/s) with 660 file(s) remaining
Completed 15.0 MiB/662.3 MiB (1.7 MiB/s) with 659 file(s) remaining
Completed 21.7 MiB/662.3 MiB (1.5 MiB/s) with 658 file(s) remaining
Completed 23.6 MiB/662.3 MiB (1.5 MiB/s) with 657 file(s) remaining
Completed 26.4 MiB/662.3 MiB (1.4 MiB/s) with 656 file(s) remaining
Completed 28.9 MiB/662.3 MiB (1.4 MiB/s) with 655 file(s) remaining
Completed 30.1 MiB/662.3 MiB (1.4 MiB/s) with 654 file(s) remaining
Completed 30.7 MiB/662.3 MiB (1.4 MiB/s) with 653 file(s) remaining
Completed 31.3 MiB/662.3 MiB (1.4 MiB/s) with 652 file(s) remaining
Completed 35.7 MiB/662.3 MiB (1.4 MiB/s) with 651 file(s) remaining
Completed 35.7 MiB/662.3 MiB (1.4 MiB/s) with 650 file(s) remaining
Completed 38.2 MiB/662.3 MiB (1.3 MiB/s) with 649 file(s) remaining
Completed 38.9 MiB/662.3 MiB (1.4 MiB/s) with 648 file(s) remaining
Completed 40.4 MiB/662.3 MiB (1.4 MiB/s) with 647 file(s) remaining
Completed 41.3 MiB/662.3 MiB (1.4 MiB/s) with 646 file(s) remaining
Completed 47.0 MiB/662.3 MiB (1.3 MiB/s) with 645 file(s) remaining
Completed 48.6 MiB/662.3 MiB (1.3 MiB/s) with 644 file(s) remaining
Completed 49.3 MiB/662.3 MiB (1.3 MiB/s) with 643 file(s) remaining
Completed 51.4 MiB/662.3 MiB (1.3 MiB/s) with 642 file(s) remaining
Completed 53.9 MiB/662.3 MiB (1.4 MiB/s) with 641 file(s) remaining
Completed 56.4 MiB/662.3 MiB (1.4 MiB/s) with 640 file(s) remaining
Completed 61.1 MiB/662.3 MiB (1.3 MiB/s) with 639 file(s) remaining
Completed 65.1 MiB/662.3 MiB (1.3 MiB/s) with 638 file(s) remaining
Completed 66.4 MiB/662.3 MiB (1.3 MiB/s) with 637 file(s) remaining
Completed 67.0 MiB/662.3 MiB (1.3 MiB/s) with 636 file(s) remaining
Completed 68.5 MiB/662.3 MiB (1.3 MiB/s) with 635 file(s) remaining
Completed 72.7 MiB/662.3 MiB (1.3 MiB/s) with 634 file(s) remaining
Completed 75.5 MiB/662.3 MiB (1.3 MiB/s) with 633 file(s) remaining
Completed 80.7 MiB/662.3 MiB (1.3 MiB/s) with 632 file(s) remaining
Completed 83.0 MiB/662.3 MiB (1.3 MiB/s) with 631 file(s) remaining
Completed 84.3 MiB/662.3 MiB (1.3 MiB/s) with 630 file(s) remaining
Completed 86.5 MiB/662.3 MiB (1.3 MiB/s) with 629 file(s) remaining
Completed 87.9 MiB/662.3 MiB (1.3 MiB/s) with 628 file(s) remaining
Completed 90.0 MiB/662.3 MiB (1.3 MiB/s) with 627 file(s) remaining
Completed 90.5 MiB/662.3 MiB (1.3 MiB/s) with 626 file(s) remaining
Completed 92.7 MiB/662.3 MiB (1.3 MiB/s) with 625 file(s) remaining
Completed 95.3 MiB/662.3 MiB (1.3 MiB/s) with 624 file(s) remaining
Completed 97.2 MiB/662.3 MiB (1.3 MiB/s) with 623 file(s) remaining
Completed 98.3 MiB/662.3 MiB (1.3 MiB/s) with 622 file(s) remaining
Completed 99.4 MiB/662.3 MiB (1.3 MiB/s) with 621 file(s) remaining
Completed 101.9 MiB/662.3 MiB (1.3 MiB/s) with 620 file(s) remaining
Completed 103.4 MiB/662.3 MiB (1.3 MiB/s) with 619 file(s) remaining
Completed 104.7 MiB/662.3 MiB (1.3 MiB/s) with 618 file(s) remaining
Completed 106.5 MiB/662.3 MiB (1.3 MiB/s) with 617 file(s) remaining
Completed 109.2 MiB/662.3 MiB (1.3 MiB/s) with 616 file(s) remaining
Completed 110.3 MiB/662.3 MiB (1.3 MiB/s) with 615 file(s) remaining
Completed 112.5 MiB/662.3 MiB (1.3 MiB/s) with 614 file(s) remaining
Completed 113.6 MiB/662.3 MiB (1.3 MiB/s) with 613 file(s) remaining
Completed 115.5 MiB/662.3 MiB (1.3 MiB/s) with 612 file(s) remaining
Completed 117.8 MiB/662.3 MiB (1.3 MiB/s) with 611 file(s) remaining
Completed 120.9 MiB/662.3 MiB (1.3 MiB/s) with 610 file(s) remaining
Completed 121.6 MiB/662.3 MiB (1.3 MiB/s) with 609 file(s) remaining
Completed 122.7 MiB/662.3 MiB (1.3 MiB/s) with 608 file(s) remaining
Completed 123.4 MiB/662.3 MiB (1.3 MiB/s) with 607 file(s) remaining
Completed 124.8 MiB/662.3 MiB (1.3 MiB/s) with 606 file(s) remaining
Completed 126.2 MiB/662.3 MiB (1.3 MiB/s) with 605 file(s) remaining
Completed 127.9 MiB/662.3 MiB (1.3 MiB/s) with 604 file(s) remaining
Completed 127.9 MiB/662.3 MiB (1.3 MiB/s) with 603 file(s) remaining
Completed 129.0 MiB/662.3 MiB (1.3 MiB/s) with 602 file(s) remaining
Completed 131.9 MiB/662.3 MiB (1.3 MiB/s) with 601 file(s) remaining
Completed 133.9 MiB/662.3 MiB (1.3 MiB/s) with 600 file(s) remaining
Completed 135.2 MiB/662.3 MiB (1.3 MiB/s) with 599 file(s) remaining
Completed 137.4 MiB/662.3 MiB (1.3 MiB/s) with 598 file(s) remaining
Completed 138.4 MiB/662.3 MiB (1.3 MiB/s) with 597 file(s) remaining
Completed 139.9 MiB/662.3 MiB (1.3 MiB/s) with 596 file(s) remaining
Completed 142.1 MiB/662.3 MiB (1.3 MiB/s) with 595 file(s) remaining
Completed 143.6 MiB/662.3 MiB (1.3 MiB/s) with 594 file(s) remaining
Completed 143.6 MiB/662.3 MiB (1.3 MiB/s) with 593 file(s) remaining
Completed 146.1 MiB/662.3 MiB (1.3 MiB/s) with 592 file(s) remaining
Completed 146.7 MiB/662.3 MiB (1.3 MiB/s) with 591 file(s) remaining
Completed 148.1 MiB/662.3 MiB (1.3 MiB/s) with 590 file(s) remaining
Completed 152.0 MiB/662.3 MiB (1.3 MiB/s) with 589 file(s) remaining
Completed 153.8 MiB/662.3 MiB (1.3 MiB/s) with 588 file(s) remaining
Completed 156.2 MiB/662.3 MiB (1.3 MiB/s) with 587 file(s) remaining
Completed 159.5 MiB/662.3 MiB (1.3 MiB/s) with 586 file(s) remaining
Completed 159.5 MiB/662.3 MiB (1.3 MiB/s) with 585 file(s) remaining
Completed 161.4 MiB/662.3 MiB (1.3 MiB/s) with 584 file(s) remaining
Completed 167.5 MiB/662.3 MiB (1.3 MiB/s) with 583 file(s) remaining
Completed 168.5 MiB/662.3 MiB (1.3 MiB/s) with 582 file(s) remaining
Completed 169.5 MiB/662.3 MiB (1.3 MiB/s) with 581 file(s) remaining
Completed 171.3 MiB/662.3 MiB (1.3 MiB/s) with 580 file(s) remaining
Completed 172.2 MiB/662.3 MiB (1.3 MiB/s) with 579 file(s) remaining
Completed 173.6 MiB/662.3 MiB (1.3 MiB/s) with 578 file(s) remaining
Completed 176.7 MiB/662.3 MiB (1.3 MiB/s) with 577 file(s) remaining
Completed 176.7 MiB/662.3 MiB (1.3 MiB/s) with 576 file(s) remaining
Completed 178.1 MiB/662.3 MiB (1.3 MiB/s) with 575 file(s) remaining
Completed 179.0 MiB/662.3 MiB (1.3 MiB/s) with 574 file(s) remaining
Completed 182.2 MiB/662.3 MiB (1.3 MiB/s) with 573 file(s) remaining
Completed 185.6 MiB/662.3 MiB (1.3 MiB/s) with 572 file(s) remaining
Completed 186.5 MiB/662.3 MiB (1.3 MiB/s) with 571 file(s) remaining
Completed 188.3 MiB/662.3 MiB (1.3 MiB/s) with 570 file(s) remaining
Completed 189.4 MiB/662.3 MiB (1.3 MiB/s) with 569 file(s) remaining
Completed 191.3 MiB/662.3 MiB (1.3 MiB/s) with 568 file(s) remaining
Completed 194.6 MiB/662.3 MiB (1.3 MiB/s) with 567 file(s) remaining
Completed 199.2 MiB/662.3 MiB (1.3 MiB/s) with 566 file(s) remaining
Completed 199.4 MiB/662.3 MiB (1.3 MiB/s) with 565 file(s) remaining
Completed 201.4 MiB/662.3 MiB (1.3 MiB/s) with 564 file(s) remaining
Completed 206.8 MiB/662.3 MiB (1.3 MiB/s) with 563 file(s) remaining
Completed 212.5 MiB/662.3 MiB (1.3 MiB/s) with 562 file(s) remaining
Completed 213.7 MiB/662.3 MiB (1.3 MiB/s) with 561 file(s) remaining
Completed 214.7 MiB/662.3 MiB (1.3 MiB/s) with 560 file(s) remaining
Completed 217.7 MiB/662.3 MiB (1.3 MiB/s) with 559 file(s) remaining
Completed 218.2 MiB/662.3 MiB (1.3 MiB/s) with 558 file(s) remaining
Completed 219.3 MiB/662.3 MiB (1.3 MiB/s) with 557 file(s) remaining
Completed 222.9 MiB/662.3 MiB (1.3 MiB/s) with 556 file(s) remaining
Completed 224.7 MiB/662.3 MiB (1.3 MiB/s) with 555 file(s) remaining
Completed 226.6 MiB/662.3 MiB (1.3 MiB/s) with 554 file(s) remaining
Completed 228.2 MiB/662.3 MiB (1.3 MiB/s) with 553 file(s) remaining
Completed 231.1 MiB/662.3 MiB (1.3 MiB/s) with 552 file(s) remaining
Completed 238.1 MiB/662.3 MiB (1.3 MiB/s) with 551 file(s) remaining
Completed 240.4 MiB/662.3 MiB (1.3 MiB/s) with 550 file(s) remaining
Completed 240.9 MiB/662.3 MiB (1.3 MiB/s) with 549 file(s) remaining
Completed 241.8 MiB/662.3 MiB (1.3 MiB/s) with 548 file(s) remaining
Completed 245.1 MiB/662.3 MiB (1.3 MiB/s) with 547 file(s) remaining
Completed 246.0 MiB/662.3 MiB (1.3 MiB/s) with 546 file(s) remaining
Completed 246.5 MiB/662.3 MiB (1.3 MiB/s) with 545 file(s) remaining
Completed 249.9 MiB/662.3 MiB (1.3 MiB/s) with 544 file(s) remaining
Completed 250.5 MiB/662.3 MiB (1.3 MiB/s) with 543 file(s) remaining
Completed 252.9 MiB/662.3 MiB (1.3 MiB/s) with 542 file(s) remaining
Completed 255.7 MiB/662.3 MiB (1.3 MiB/s) with 541 file(s) remaining
Completed 263.3 MiB/662.3 MiB (1.3 MiB/s) with 540 file(s) remaining
Completed 268.4 MiB/662.3 MiB (1.3 MiB/s) with 539 file(s) remaining
Completed 270.6 MiB/662.3 MiB (1.3 MiB/s) with 538 file(s) remaining
Completed 271.9 MiB/662.3 MiB (1.3 MiB/s) with 537 file(s) remaining
Completed 273.5 MiB/662.3 MiB (1.3 MiB/s) with 536 file(s) remaining
Completed 275.9 MiB/662.3 MiB (1.3 MiB/s) with 535 file(s) remaining
Completed 278.3 MiB/662.3 MiB (1.3 MiB/s) with 534 file(s) remaining
Completed 279.3 MiB/662.3 MiB (1.3 MiB/s) with 533 file(s) remaining
Completed 281.6 MiB/662.3 MiB (1.3 MiB/s) with 532 file(s) remaining
Completed 283.1 MiB/662.3 MiB (1.3 MiB/s) with 531 file(s) remaining
Completed 286.3 MiB/662.3 MiB (1.3 MiB/s) with 530 file(s) remaining
Completed 290.0 MiB/662.3 MiB (1.3 MiB/s) with 529 file(s) remaining
Completed 290.1 MiB/662.3 MiB (1.3 MiB/s) with 528 file(s) remaining
Completed 290.3 MiB/662.3 MiB (1.3 MiB/s) with 527 file(s) remaining
Completed 290.4 MiB/662.3 MiB (1.3 MiB/s) with 526 file(s) remaining
Completed 291.7 MiB/662.3 MiB (1.3 MiB/s) with 525 file(s) remaining
Completed 292.1 MiB/662.3 MiB (1.3 MiB/s) with 524 file(s) remaining
Completed 292.1 MiB/662.3 MiB (1.3 MiB/s) with 523 file(s) remaining
Completed 292.7 MiB/662.3 MiB (1.3 MiB/s) with 522 file(s) remaining
Completed 293.0 MiB/662.3 MiB (1.3 MiB/s) with 521 file(s) remaining
Completed 294.0 MiB/662.3 MiB (1.3 MiB/s) with 520 file(s) remaining
Completed 295.0 MiB/662.3 MiB (1.3 MiB/s) with 519 file(s) remaining
Completed 295.7 MiB/662.3 MiB (1.3 MiB/s) with 518 file(s) remaining
Completed 297.4 MiB/662.3 MiB (1.3 MiB/s) with 517 file(s) remaining
Completed 300.8 MiB/662.3 MiB (1.3 MiB/s) with 516 file(s) remaining
Completed 300.9 MiB/662.3 MiB (1.3 MiB/s) with 515 file(s) remaining
Completed 301.5 MiB/662.3 MiB (1.3 MiB/s) with 514 file(s) remaining
Completed 305.3 MiB/662.3 MiB (1.3 MiB/s) with 513 file(s) remaining
Completed 307.0 MiB/662.3 MiB (1.3 MiB/s) with 512 file(s) remaining
Completed 309.6 MiB/662.3 MiB (1.3 MiB/s) with 511 file(s) remaining
Completed 310.4 MiB/662.3 MiB (1.3 MiB/s) with 510 file(s) remaining
Completed 311.5 MiB/662.3 MiB (1.3 MiB/s) with 509 file(s) remaining
Completed 312.8 MiB/662.3 MiB (1.3 MiB/s) with 508 file(s) remaining
Completed 315.0 MiB/662.3 MiB (1.3 MiB/s) with 507 file(s) remaining
Completed 315.4 MiB/662.3 MiB (1.3 MiB/s) with 506 file(s) remaining
Completed 315.6 MiB/662.3 MiB (1.3 MiB/s) with 505 file(s) remaining
Completed 317.9 MiB/662.3 MiB (1.3 MiB/s) with 504 file(s) remaining
Completed 317.9 MiB/662.3 MiB (1.3 MiB/s) with 503 file(s) remaining
Completed 319.7 MiB/662.3 MiB (1.3 MiB/s) with 502 file(s) remaining
Completed 320.4 MiB/662.3 MiB (1.3 MiB/s) with 501 file(s) remaining
Completed 320.6 MiB/662.3 MiB (1.3 MiB/s) with 500 file(s) remaining
Completed 320.7 MiB/662.3 MiB (1.3 MiB/s) with 499 file(s) remaining
Completed 321.6 MiB/662.3 MiB (1.3 MiB/s) with 498 file(s) remaining
Completed 322.7 MiB/662.3 MiB (1.3 MiB/s) with 497 file(s) remaining
Completed 323.4 MiB/662.3 MiB (1.3 MiB/s) with 496 file(s) remaining
Completed 323.9 MiB/662.3 MiB (1.3 MiB/s) with 495 file(s) remaining
Completed 324.3 MiB/662.3 MiB (1.3 MiB/s) with 494 file(s) remaining
Completed 325.1 MiB/662.3 MiB (1.2 MiB/s) with 493 file(s) remaining
Completed 325.1 MiB/662.3 MiB (1.2 MiB/s) with 492 file(s) remaining
Completed 326.0 MiB/662.3 MiB (1.2 MiB/s) with 491 file(s) remaining
Completed 326.2 MiB/662.3 MiB (1.3 MiB/s) with 490 file(s) remaining
Completed 327.4 MiB/662.3 MiB (1.3 MiB/s) with 489 file(s) remaining
Completed 327.9 MiB/662.3 MiB (1.3 MiB/s) with 488 file(s) remaining
Completed 327.9 MiB/662.3 MiB (1.3 MiB/s) with 487 file(s) remaining
Completed 328.4 MiB/662.3 MiB (1.2 MiB/s) with 486 file(s) remaining
Completed 328.8 MiB/662.3 MiB (1.2 MiB/s) with 485 file(s) remaining
Completed 329.3 MiB/662.3 MiB (1.2 MiB/s) with 484 file(s) remaining
Completed 329.9 MiB/662.3 MiB (1.2 MiB/s) with 483 file(s) remaining
Completed 329.9 MiB/662.3 MiB (1.2 MiB/s) with 482 file(s) remaining
Completed 330.5 MiB/662.3 MiB (1.2 MiB/s) with 481 file(s) remaining
Completed 330.6 MiB/662.3 MiB (1.3 MiB/s) with 480 file(s) remaining
Completed 331.1 MiB/662.3 MiB (1.2 MiB/s) with 479 file(s) remaining
Completed 331.7 MiB/662.3 MiB (1.2 MiB/s) with 478 file(s) remaining
Completed 332.4 MiB/662.3 MiB (1.2 MiB/s) with 477 file(s) remaining
Completed 332.7 MiB/662.3 MiB (1.2 MiB/s) with 476 file(s) remaining
Completed 332.9 MiB/662.3 MiB (1.2 MiB/s) with 475 file(s) remaining
Completed 333.6 MiB/662.3 MiB (1.2 MiB/s) with 474 file(s) remaining
Completed 334.1 MiB/662.3 MiB (1.2 MiB/s) with 473 file(s) remaining
Completed 334.6 MiB/662.3 MiB (1.2 MiB/s) with 472 file(s) remaining
Completed 335.1 MiB/662.3 MiB (1.2 MiB/s) with 471 file(s) remaining
Completed 335.3 MiB/662.3 MiB (1.2 MiB/s) with 470 file(s) remaining
Completed 336.0 MiB/662.3 MiB (1.2 MiB/s) with 469 file(s) remaining
Completed 336.5 MiB/662.3 MiB (1.2 MiB/s) with 468 file(s) remaining
Completed 337.0 MiB/662.3 MiB (1.2 MiB/s) with 467 file(s) remaining
Completed 337.5 MiB/662.3 MiB (1.2 MiB/s) with 466 file(s) remaining
Completed 337.9 MiB/662.3 MiB (1.2 MiB/s) with 465 file(s) remaining
Completed 338.2 MiB/662.3 MiB (1.2 MiB/s) with 464 file(s) remaining
Completed 338.7 MiB/662.3 MiB (1.2 MiB/s) with 463 file(s) remaining
Completed 339.4 MiB/662.3 MiB (1.2 MiB/s) with 462 file(s) remaining
Completed 339.9 MiB/662.3 MiB (1.2 MiB/s) with 461 file(s) remaining
Completed 340.2 MiB/662.3 MiB (1.2 MiB/s) with 460 file(s) remaining
Completed 340.5 MiB/662.3 MiB (1.2 MiB/s) with 459 file(s) remaining
Completed 340.7 MiB/662.3 MiB (1.2 MiB/s) with 458 file(s) remaining
Completed 341.0 MiB/662.3 MiB (1.2 MiB/s) with 457 file(s) remaining
Completed 341.2 MiB/662.3 MiB (1.2 MiB/s) with 456 file(s) remaining
Completed 341.5 MiB/662.3 MiB (1.2 MiB/s) with 455 file(s) remaining
Completed 342.0 MiB/662.3 MiB (1.2 MiB/s) with 454 file(s) remaining
Completed 342.5 MiB/662.3 MiB (1.2 MiB/s) with 453 file(s) remaining
Completed 343.1 MiB/662.3 MiB (1.2 MiB/s) with 452 file(s) remaining
Completed 343.4 MiB/662.3 MiB (1.2 MiB/s) with 451 file(s) remaining
Completed 343.5 MiB/662.3 MiB (1.2 MiB/s) with 450 file(s) remaining
Completed 343.9 MiB/662.3 MiB (1.2 MiB/s) with 449 file(s) remaining
Completed 344.3 MiB/662.3 MiB (1.2 MiB/s) with 448 file(s) remaining
Completed 344.8 MiB/662.3 MiB (1.2 MiB/s) with 447 file(s) remaining
Completed 345.0 MiB/662.3 MiB (1.2 MiB/s) with 446 file(s) remaining
Completed 345.5 MiB/662.3 MiB (1.2 MiB/s) with 445 file(s) remaining
Completed 345.9 MiB/662.3 MiB (1.2 MiB/s) with 444 file(s) remaining
Completed 345.9 MiB/662.3 MiB (1.2 MiB/s) with 443 file(s) remaining
Completed 346.4 MiB/662.3 MiB (1.2 MiB/s) with 442 file(s) remaining
Completed 346.8 MiB/662.3 MiB (1.2 MiB/s) with 441 file(s) remaining
Completed 347.1 MiB/662.3 MiB (1.2 MiB/s) with 440 file(s) remaining
Completed 347.4 MiB/662.3 MiB (1.2 MiB/s) with 439 file(s) remaining
Completed 347.8 MiB/662.3 MiB (1.2 MiB/s) with 438 file(s) remaining
Completed 348.2 MiB/662.3 MiB (1.2 MiB/s) with 436 file(s) remaining
Completed 347.8 MiB/662.3 MiB (1.2 MiB/s) with 437 file(s) remaining
Completed 348.2 MiB/662.3 MiB (1.2 MiB/s) with 435 file(s) remaining
Completed 349.1 MiB/662.3 MiB (1.2 MiB/s) with 434 file(s) remaining
Completed 349.4 MiB/662.3 MiB (1.2 MiB/s) with 433 file(s) remaining
Completed 349.7 MiB/662.3 MiB (1.2 MiB/s) with 432 file(s) remaining
Completed 350.1 MiB/662.3 MiB (1.2 MiB/s) with 431 file(s) remaining
Completed 350.4 MiB/662.3 MiB (1.2 MiB/s) with 430 file(s) remaining
Completed 350.7 MiB/662.3 MiB (1.2 MiB/s) with 429 file(s) remaining
Completed 351.0 MiB/662.3 MiB (1.2 MiB/s) with 428 file(s) remaining
Completed 351.7 MiB/662.3 MiB (1.2 MiB/s) with 427 file(s) remaining
Completed 352.1 MiB/662.3 MiB (1.2 MiB/s) with 426 file(s) remaining
Completed 352.1 MiB/662.3 MiB (1.2 MiB/s) with 425 file(s) remaining
Completed 352.1 MiB/662.3 MiB (1.2 MiB/s) with 424 file(s) remaining
Completed 352.7 MiB/662.3 MiB (1.2 MiB/s) with 423 file(s) remaining
Completed 353.3 MiB/662.3 MiB (1.2 MiB/s) with 422 file(s) remaining
Completed 353.6 MiB/662.3 MiB (1.2 MiB/s) with 421 file(s) remaining
Completed 353.8 MiB/662.3 MiB (1.2 MiB/s) with 420 file(s) remaining
Completed 354.3 MiB/662.3 MiB (1.2 MiB/s) with 419 file(s) remaining
Completed 354.7 MiB/662.3 MiB (1.2 MiB/s) with 418 file(s) remaining
Completed 355.1 MiB/662.3 MiB (1.2 MiB/s) with 417 file(s) remaining
Completed 355.6 MiB/662.3 MiB (1.2 MiB/s) with 416 file(s) remaining
Completed 356.1 MiB/662.3 MiB (1.2 MiB/s) with 415 file(s) remaining
Completed 356.3 MiB/662.3 MiB (1.2 MiB/s) with 414 file(s) remaining
Completed 356.4 MiB/662.3 MiB (1.2 MiB/s) with 413 file(s) remaining
Completed 356.9 MiB/662.3 MiB (1.2 MiB/s) with 412 file(s) remaining
Completed 357.4 MiB/662.3 MiB (1.2 MiB/s) with 411 file(s) remaining
Completed 357.4 MiB/662.3 MiB (1.2 MiB/s) with 410 file(s) remaining
Completed 358.1 MiB/662.3 MiB (1.2 MiB/s) with 409 file(s) remaining
Completed 358.3 MiB/662.3 MiB (1.2 MiB/s) with 408 file(s) remaining
Completed 358.9 MiB/662.3 MiB (1.2 MiB/s) with 407 file(s) remaining
Completed 359.3 MiB/662.3 MiB (1.2 MiB/s) with 406 file(s) remaining
Completed 359.3 MiB/662.3 MiB (1.2 MiB/s) with 405 file(s) remaining
Completed 360.0 MiB/662.3 MiB (1.2 MiB/s) with 404 file(s) remaining
Completed 360.7 MiB/662.3 MiB (1.2 MiB/s) with 403 file(s) remaining
Completed 360.9 MiB/662.3 MiB (1.2 MiB/s) with 402 file(s) remaining
Completed 361.5 MiB/662.3 MiB (1.2 MiB/s) with 401 file(s) remaining
Completed 362.0 MiB/662.3 MiB (1.2 MiB/s) with 400 file(s) remaining
Completed 362.2 MiB/662.3 MiB (1.2 MiB/s) with 399 file(s) remaining
Completed 362.9 MiB/662.3 MiB (1.2 MiB/s) with 398 file(s) remaining
Completed 363.1 MiB/662.3 MiB (1.2 MiB/s) with 397 file(s) remaining
Completed 363.9 MiB/662.3 MiB (1.2 MiB/s) with 396 file(s) remaining
Completed 364.2 MiB/662.3 MiB (1.2 MiB/s) with 395 file(s) remaining
Completed 364.6 MiB/662.3 MiB (1.2 MiB/s) with 394 file(s) remaining
Completed 364.9 MiB/662.3 MiB (1.2 MiB/s) with 393 file(s) remaining
Completed 365.3 MiB/662.3 MiB (1.2 MiB/s) with 392 file(s) remaining
Completed 366.0 MiB/662.3 MiB (1.2 MiB/s) with 391 file(s) remaining
Completed 366.2 MiB/662.3 MiB (1.2 MiB/s) with 389 file(s) remaining
Completed 366.0 MiB/662.3 MiB (1.2 MiB/s) with 390 file(s) remaining
Completed 366.9 MiB/662.3 MiB (1.2 MiB/s) with 388 file(s) remaining
Completed 367.6 MiB/662.3 MiB (1.2 MiB/s) with 387 file(s) remaining
Completed 368.0 MiB/662.3 MiB (1.2 MiB/s) with 386 file(s) remaining
Completed 368.4 MiB/662.3 MiB (1.2 MiB/s) with 385 file(s) remaining
Completed 368.6 MiB/662.3 MiB (1.2 MiB/s) with 384 file(s) remaining
Completed 369.4 MiB/662.3 MiB (1.2 MiB/s) with 383 file(s) remaining
Completed 369.7 MiB/662.3 MiB (1.2 MiB/s) with 382 file(s) remaining
Completed 369.9 MiB/662.3 MiB (1.2 MiB/s) with 381 file(s) remaining
Completed 370.9 MiB/662.3 MiB (1.2 MiB/s) with 380 file(s) remaining
Completed 371.4 MiB/662.3 MiB (1.2 MiB/s) with 379 file(s) remaining
Completed 372.1 MiB/662.3 MiB (1.2 MiB/s) with 378 file(s) remaining
Completed 372.3 MiB/662.3 MiB (1.2 MiB/s) with 377 file(s) remaining
Completed 373.1 MiB/662.3 MiB (1.2 MiB/s) with 376 file(s) remaining
Completed 373.8 MiB/662.3 MiB (1.2 MiB/s) with 375 file(s) remaining
Completed 374.1 MiB/662.3 MiB (1.2 MiB/s) with 374 file(s) remaining
Completed 374.5 MiB/662.3 MiB (1.2 MiB/s) with 373 file(s) remaining
Completed 374.8 MiB/662.3 MiB (1.2 MiB/s) with 372 file(s) remaining
Completed 375.2 MiB/662.3 MiB (1.2 MiB/s) with 371 file(s) remaining
Completed 375.7 MiB/662.3 MiB (1.2 MiB/s) with 370 file(s) remaining
Completed 376.0 MiB/662.3 MiB (1.2 MiB/s) with 369 file(s) remaining
Completed 376.5 MiB/662.3 MiB (1.2 MiB/s) with 368 file(s) remaining
Completed 376.5 MiB/662.3 MiB (1.2 MiB/s) with 367 file(s) remaining
Completed 377.2 MiB/662.3 MiB (1.2 MiB/s) with 366 file(s) remaining
Completed 377.6 MiB/662.3 MiB (1.2 MiB/s) with 365 file(s) remaining
Completed 377.8 MiB/662.3 MiB (1.2 MiB/s) with 364 file(s) remaining
Completed 378.2 MiB/662.3 MiB (1.2 MiB/s) with 363 file(s) remaining
Completed 378.2 MiB/662.3 MiB (1.2 MiB/s) with 362 file(s) remaining
Completed 378.3 MiB/662.3 MiB (1.2 MiB/s) with 361 file(s) remaining
Completed 378.4 MiB/662.3 MiB (1.2 MiB/s) with 360 file(s) remaining
Completed 378.6 MiB/662.3 MiB (1.2 MiB/s) with 359 file(s) remaining
Completed 378.6 MiB/662.3 MiB (1.2 MiB/s) with 358 file(s) remaining
Completed 378.7 MiB/662.3 MiB (1.2 MiB/s) with 357 file(s) remaining
Completed 378.8 MiB/662.3 MiB (1.2 MiB/s) with 356 file(s) remaining
Completed 379.7 MiB/662.3 MiB (1.2 MiB/s) with 355 file(s) remaining
Completed 380.0 MiB/662.3 MiB (1.2 MiB/s) with 354 file(s) remaining
Completed 380.0 MiB/662.3 MiB (1.2 MiB/s) with 353 file(s) remaining
Completed 381.0 MiB/662.3 MiB (1.2 MiB/s) with 352 file(s) remaining
Completed 381.0 MiB/662.3 MiB (1.2 MiB/s) with 351 file(s) remaining
Completed 381.5 MiB/662.3 MiB (1.2 MiB/s) with 350 file(s) remaining
Completed 382.0 MiB/662.3 MiB (1.2 MiB/s) with 349 file(s) remaining
Completed 382.3 MiB/662.3 MiB (1.2 MiB/s) with 348 file(s) remaining
Completed 382.6 MiB/662.3 MiB (1.2 MiB/s) with 347 file(s) remaining
Completed 383.1 MiB/662.3 MiB (1.2 MiB/s) with 346 file(s) remaining
Completed 383.4 MiB/662.3 MiB (1.2 MiB/s) with 345 file(s) remaining
Completed 383.6 MiB/662.3 MiB (1.2 MiB/s) with 344 file(s) remaining
Completed 383.8 MiB/662.3 MiB (1.2 MiB/s) with 343 file(s) remaining
Completed 384.0 MiB/662.3 MiB (1.2 MiB/s) with 342 file(s) remaining
Completed 384.2 MiB/662.3 MiB (1.2 MiB/s) with 341 file(s) remaining
Completed 384.2 MiB/662.3 MiB (1.2 MiB/s) with 340 file(s) remaining
Completed 384.2 MiB/662.3 MiB (1.2 MiB/s) with 339 file(s) remaining
Completed 385.1 MiB/662.3 MiB (1.2 MiB/s) with 338 file(s) remaining
Completed 385.5 MiB/662.3 MiB (1.2 MiB/s) with 337 file(s) remaining
Completed 386.3 MiB/662.3 MiB (1.2 MiB/s) with 336 file(s) remaining
Completed 386.8 MiB/662.3 MiB (1.2 MiB/s) with 335 file(s) remaining
Completed 387.0 MiB/662.3 MiB (1.2 MiB/s) with 334 file(s) remaining
Completed 388.0 MiB/662.3 MiB (1.2 MiB/s) with 333 file(s) remaining
Completed 388.7 MiB/662.3 MiB (1.2 MiB/s) with 332 file(s) remaining
Completed 389.2 MiB/662.3 MiB (1.2 MiB/s) with 331 file(s) remaining
Completed 389.9 MiB/662.3 MiB (1.2 MiB/s) with 330 file(s) remaining
Completed 390.0 MiB/662.3 MiB (1.2 MiB/s) with 329 file(s) remaining
Completed 391.4 MiB/662.3 MiB (1.2 MiB/s) with 328 file(s) remaining
Completed 392.4 MiB/662.3 MiB (1.3 MiB/s) with 327 file(s) remaining
Completed 393.3 MiB/662.3 MiB (1.3 MiB/s) with 326 file(s) remaining
Completed 393.5 MiB/662.3 MiB (1.3 MiB/s) with 325 file(s) remaining
Completed 393.5 MiB/662.3 MiB (1.3 MiB/s) with 324 file(s) remaining
Completed 395.6 MiB/662.3 MiB (1.2 MiB/s) with 323 file(s) remaining
Completed 395.9 MiB/662.3 MiB (1.2 MiB/s) with 322 file(s) remaining
Completed 396.0 MiB/662.3 MiB (1.2 MiB/s) with 321 file(s) remaining
Completed 396.7 MiB/662.3 MiB (1.2 MiB/s) with 320 file(s) remaining
Completed 397.3 MiB/662.3 MiB (1.2 MiB/s) with 319 file(s) remaining
Completed 398.2 MiB/662.3 MiB (1.2 MiB/s) with 318 file(s) remaining
Completed 398.9 MiB/662.3 MiB (1.2 MiB/s) with 317 file(s) remaining
Completed 399.4 MiB/662.3 MiB (1.2 MiB/s) with 316 file(s) remaining
Completed 399.7 MiB/662.3 MiB (1.2 MiB/s) with 315 file(s) remaining
Completed 401.2 MiB/662.3 MiB (1.2 MiB/s) with 314 file(s) remaining
Completed 401.9 MiB/662.3 MiB (1.2 MiB/s) with 313 file(s) remaining
Completed 401.9 MiB/662.3 MiB (1.2 MiB/s) with 312 file(s) remaining
Completed 403.4 MiB/662.3 MiB (1.2 MiB/s) with 311 file(s) remaining
Completed 404.1 MiB/662.3 MiB (1.2 MiB/s) with 310 file(s) remaining
Completed 405.3 MiB/662.3 MiB (1.3 MiB/s) with 309 file(s) remaining
Completed 406.3 MiB/662.3 MiB (1.3 MiB/s) with 308 file(s) remaining
Completed 406.9 MiB/662.3 MiB (1.3 MiB/s) with 307 file(s) remaining
Completed 407.7 MiB/662.3 MiB (1.3 MiB/s) with 306 file(s) remaining
Completed 407.9 MiB/662.3 MiB (1.3 MiB/s) with 305 file(s) remaining
Completed 409.5 MiB/662.3 MiB (1.3 MiB/s) with 304 file(s) remaining
Completed 410.6 MiB/662.3 MiB (1.3 MiB/s) with 303 file(s) remaining
Completed 410.9 MiB/662.3 MiB (1.3 MiB/s) with 302 file(s) remaining
Completed 411.2 MiB/662.3 MiB (1.2 MiB/s) with 301 file(s) remaining
Completed 411.7 MiB/662.3 MiB (1.2 MiB/s) with 300 file(s) remaining
Completed 412.0 MiB/662.3 MiB (1.2 MiB/s) with 299 file(s) remaining
Completed 412.3 MiB/662.3 MiB (1.2 MiB/s) with 298 file(s) remaining
Completed 412.7 MiB/662.3 MiB (1.2 MiB/s) with 297 file(s) remaining
Completed 413.2 MiB/662.3 MiB (1.2 MiB/s) with 296 file(s) remaining
Completed 413.3 MiB/662.3 MiB (1.2 MiB/s) with 295 file(s) remaining
Completed 414.8 MiB/662.3 MiB (1.2 MiB/s) with 294 file(s) remaining
Completed 415.5 MiB/662.3 MiB (1.2 MiB/s) with 293 file(s) remaining
Completed 415.9 MiB/662.3 MiB (1.2 MiB/s) with 292 file(s) remaining
Completed 416.0 MiB/662.3 MiB (1.2 MiB/s) with 291 file(s) remaining
Completed 416.7 MiB/662.3 MiB (1.2 MiB/s) with 290 file(s) remaining
Completed 416.9 MiB/662.3 MiB (1.2 MiB/s) with 289 file(s) remaining
Completed 417.4 MiB/662.3 MiB (1.2 MiB/s) with 288 file(s) remaining
Completed 418.1 MiB/662.3 MiB (1.2 MiB/s) with 287 file(s) remaining
Completed 418.4 MiB/662.3 MiB (1.2 MiB/s) with 286 file(s) remaining
Completed 418.7 MiB/662.3 MiB (1.2 MiB/s) with 285 file(s) remaining
Completed 419.0 MiB/662.3 MiB (1.2 MiB/s) with 284 file(s) remaining
Completed 419.4 MiB/662.3 MiB (1.2 MiB/s) with 283 file(s) remaining
Completed 420.2 MiB/662.3 MiB (1.2 MiB/s) with 282 file(s) remaining
Completed 420.7 MiB/662.3 MiB (1.2 MiB/s) with 281 file(s) remaining
Completed 421.1 MiB/662.3 MiB (1.2 MiB/s) with 280 file(s) remaining
Completed 421.5 MiB/662.3 MiB (1.2 MiB/s) with 279 file(s) remaining
Completed 421.7 MiB/662.3 MiB (1.2 MiB/s) with 278 file(s) remaining
Completed 422.4 MiB/662.3 MiB (1.2 MiB/s) with 277 file(s) remaining
Completed 422.7 MiB/662.3 MiB (1.2 MiB/s) with 276 file(s) remaining
Completed 423.1 MiB/662.3 MiB (1.2 MiB/s) with 275 file(s) remaining
Completed 423.4 MiB/662.3 MiB (1.2 MiB/s) with 274 file(s) remaining
Completed 423.8 MiB/662.3 MiB (1.2 MiB/s) with 273 file(s) remaining
Completed 424.0 MiB/662.3 MiB (1.2 MiB/s) with 272 file(s) remaining
Completed 424.3 MiB/662.3 MiB (1.2 MiB/s) with 271 file(s) remaining
Completed 424.7 MiB/662.3 MiB (1.2 MiB/s) with 270 file(s) remaining
Completed 425.4 MiB/662.3 MiB (1.2 MiB/s) with 269 file(s) remaining
Completed 426.2 MiB/662.3 MiB (1.2 MiB/s) with 268 file(s) remaining
Completed 426.7 MiB/662.3 MiB (1.2 MiB/s) with 267 file(s) remaining
Completed 427.1 MiB/662.3 MiB (1.2 MiB/s) with 266 file(s) remaining
Completed 427.8 MiB/662.3 MiB (1.2 MiB/s) with 265 file(s) remaining
Completed 428.2 MiB/662.3 MiB (1.2 MiB/s) with 264 file(s) remaining
Completed 428.9 MiB/662.3 MiB (1.2 MiB/s) with 263 file(s) remaining
Completed 429.6 MiB/662.3 MiB (1.2 MiB/s) with 262 file(s) remaining
Completed 430.5 MiB/662.3 MiB (1.2 MiB/s) with 261 file(s) remaining
Completed 431.4 MiB/662.3 MiB (1.2 MiB/s) with 260 file(s) remaining
Completed 431.8 MiB/662.3 MiB (1.2 MiB/s) with 259 file(s) remaining
Completed 432.4 MiB/662.3 MiB (1.2 MiB/s) with 258 file(s) remaining
Completed 433.3 MiB/662.3 MiB (1.2 MiB/s) with 257 file(s) remaining
Completed 434.0 MiB/662.3 MiB (1.2 MiB/s) with 256 file(s) remaining
Completed 434.0 MiB/662.3 MiB (1.2 MiB/s) with 255 file(s) remaining
Completed 435.2 MiB/662.3 MiB (1.2 MiB/s) with 254 file(s) remaining
Completed 435.9 MiB/662.3 MiB (1.2 MiB/s) with 253 file(s) remaining
Completed 436.7 MiB/662.3 MiB (1.2 MiB/s) with 252 file(s) remaining
Completed 437.2 MiB/662.3 MiB (1.2 MiB/s) with 251 file(s) remaining
Completed 437.7 MiB/662.3 MiB (1.2 MiB/s) with 250 file(s) remaining
Completed 438.0 MiB/662.3 MiB (1.2 MiB/s) with 249 file(s) remaining
Completed 438.2 MiB/662.3 MiB (1.2 MiB/s) with 248 file(s) remaining
Completed 439.0 MiB/662.3 MiB (1.2 MiB/s) with 247 file(s) remaining
Completed 439.3 MiB/662.3 MiB (1.2 MiB/s) with 246 file(s) remaining
Completed 439.9 MiB/662.3 MiB (1.2 MiB/s) with 245 file(s) remaining
Completed 440.8 MiB/662.3 MiB (1.2 MiB/s) with 244 file(s) remaining
Completed 441.4 MiB/662.3 MiB (1.2 MiB/s) with 243 file(s) remaining
Completed 442.0 MiB/662.3 MiB (1.2 MiB/s) with 242 file(s) remaining
Completed 443.2 MiB/662.3 MiB (1.2 MiB/s) with 241 file(s) remaining
Completed 443.8 MiB/662.3 MiB (1.2 MiB/s) with 240 file(s) remaining
Completed 444.4 MiB/662.3 MiB (1.2 MiB/s) with 239 file(s) remaining
Completed 445.0 MiB/662.3 MiB (1.2 MiB/s) with 238 file(s) remaining
Completed 445.8 MiB/662.3 MiB (1.2 MiB/s) with 237 file(s) remaining
Completed 446.3 MiB/662.3 MiB (1.2 MiB/s) with 236 file(s) remaining
Completed 447.5 MiB/662.3 MiB (1.2 MiB/s) with 235 file(s) remaining
Completed 448.3 MiB/662.3 MiB (1.2 MiB/s) with 234 file(s) remaining
Completed 448.9 MiB/662.3 MiB (1.3 MiB/s) with 233 file(s) remaining
Completed 449.7 MiB/662.3 MiB (1.3 MiB/s) with 232 file(s) remaining
Completed 450.4 MiB/662.3 MiB (1.2 MiB/s) with 231 file(s) remaining
Completed 450.6 MiB/662.3 MiB (1.2 MiB/s) with 230 file(s) remaining
Completed 451.6 MiB/662.3 MiB (1.2 MiB/s) with 229 file(s) remaining
Completed 452.5 MiB/662.3 MiB (1.2 MiB/s) with 228 file(s) remaining
Completed 452.6 MiB/662.3 MiB (1.2 MiB/s) with 227 file(s) remaining
Completed 453.7 MiB/662.3 MiB (1.2 MiB/s) with 226 file(s) remaining
Completed 454.7 MiB/662.3 MiB (1.2 MiB/s) with 225 file(s) remaining
Completed 455.3 MiB/662.3 MiB (1.2 MiB/s) with 224 file(s) remaining
Completed 455.9 MiB/662.3 MiB (1.2 MiB/s) with 223 file(s) remaining
Completed 456.6 MiB/662.3 MiB (1.2 MiB/s) with 222 file(s) remaining
Completed 457.1 MiB/662.3 MiB (1.2 MiB/s) with 221 file(s) remaining
Completed 457.2 MiB/662.3 MiB (1.2 MiB/s) with 220 file(s) remaining
Completed 458.6 MiB/662.3 MiB (1.2 MiB/s) with 219 file(s) remaining
Completed 458.6 MiB/662.3 MiB (1.2 MiB/s) with 218 file(s) remaining
Completed 459.6 MiB/662.3 MiB (1.2 MiB/s) with 217 file(s) remaining
Completed 460.9 MiB/662.3 MiB (1.2 MiB/s) with 216 file(s) remaining
Completed 461.5 MiB/662.3 MiB (1.2 MiB/s) with 215 file(s) remaining
Completed 462.2 MiB/662.3 MiB (1.2 MiB/s) with 214 file(s) remaining
Completed 463.0 MiB/662.3 MiB (1.2 MiB/s) with 213 file(s) remaining
Completed 464.1 MiB/662.3 MiB (1.3 MiB/s) with 212 file(s) remaining
Completed 465.2 MiB/662.3 MiB (1.2 MiB/s) with 211 file(s) remaining
Completed 466.1 MiB/662.3 MiB (1.2 MiB/s) with 210 file(s) remaining
Completed 466.7 MiB/662.3 MiB (1.2 MiB/s) with 209 file(s) remaining
Completed 467.5 MiB/662.3 MiB (1.2 MiB/s) with 208 file(s) remaining
Completed 468.0 MiB/662.3 MiB (1.2 MiB/s) with 207 file(s) remaining
Completed 468.7 MiB/662.3 MiB (1.2 MiB/s) with 206 file(s) remaining
Completed 468.7 MiB/662.3 MiB (1.2 MiB/s) with 205 file(s) remaining
Completed 468.9 MiB/662.3 MiB (1.2 MiB/s) with 204 file(s) remaining
Completed 470.0 MiB/662.3 MiB (1.2 MiB/s) with 203 file(s) remaining
Completed 470.3 MiB/662.3 MiB (1.2 MiB/s) with 202 file(s) remaining
Completed 470.9 MiB/662.3 MiB (1.2 MiB/s) with 201 file(s) remaining
Completed 471.4 MiB/662.3 MiB (1.2 MiB/s) with 200 file(s) remaining
Completed 471.8 MiB/662.3 MiB (1.2 MiB/s) with 199 file(s) remaining
Completed 471.9 MiB/662.3 MiB (1.2 MiB/s) with 198 file(s) remaining
Completed 472.1 MiB/662.3 MiB (1.2 MiB/s) with 197 file(s) remaining
Completed 472.3 MiB/662.3 MiB (1.2 MiB/s) with 196 file(s) remaining
Completed 472.4 MiB/662.3 MiB (1.2 MiB/s) with 195 file(s) remaining
Completed 472.4 MiB/662.3 MiB (1.2 MiB/s) with 194 file(s) remaining
Completed 472.5 MiB/662.3 MiB (1.2 MiB/s) with 193 file(s) remaining
Completed 472.5 MiB/662.3 MiB (1.2 MiB/s) with 192 file(s) remaining
Completed 472.6 MiB/662.3 MiB (1.2 MiB/s) with 191 file(s) remaining
Completed 473.5 MiB/662.3 MiB (1.2 MiB/s) with 190 file(s) remaining
Completed 474.1 MiB/662.3 MiB (1.2 MiB/s) with 189 file(s) remaining
Completed 474.3 MiB/662.3 MiB (1.2 MiB/s) with 188 file(s) remaining
Completed 475.8 MiB/662.3 MiB (1.2 MiB/s) with 187 file(s) remaining
Completed 475.9 MiB/662.3 MiB (1.2 MiB/s) with 186 file(s) remaining
Completed 477.0 MiB/662.3 MiB (1.2 MiB/s) with 185 file(s) remaining
Completed 477.9 MiB/662.3 MiB (1.2 MiB/s) with 184 file(s) remaining
Completed 478.4 MiB/662.3 MiB (1.2 MiB/s) with 183 file(s) remaining
Completed 478.4 MiB/662.3 MiB (1.2 MiB/s) with 182 file(s) remaining
Completed 480.6 MiB/662.3 MiB (1.2 MiB/s) with 181 file(s) remaining
Completed 481.7 MiB/662.3 MiB (1.2 MiB/s) with 180 file(s) remaining
Completed 482.2 MiB/662.3 MiB (1.2 MiB/s) with 179 file(s) remaining
Completed 482.3 MiB/662.3 MiB (1.2 MiB/s) with 178 file(s) remaining
Completed 482.5 MiB/662.3 MiB (1.2 MiB/s) with 177 file(s) remaining
Completed 482.5 MiB/662.3 MiB (1.2 MiB/s) with 176 file(s) remaining
Completed 482.5 MiB/662.3 MiB (1.2 MiB/s) with 175 file(s) remaining
Completed 482.6 MiB/662.3 MiB (1.2 MiB/s) with 174 file(s) remaining
Completed 482.6 MiB/662.3 MiB (1.2 MiB/s) with 173 file(s) remaining
Completed 484.5 MiB/662.3 MiB (1.2 MiB/s) with 172 file(s) remaining
Completed 485.7 MiB/662.3 MiB (1.3 MiB/s) with 171 file(s) remaining
Completed 486.5 MiB/662.3 MiB (1.3 MiB/s) with 170 file(s) remaining
Completed 487.6 MiB/662.3 MiB (1.3 MiB/s) with 169 file(s) remaining
Completed 489.0 MiB/662.3 MiB (1.2 MiB/s) with 168 file(s) remaining
Completed 489.7 MiB/662.3 MiB (1.2 MiB/s) with 167 file(s) remaining
Completed 491.2 MiB/662.3 MiB (1.2 MiB/s) with 166 file(s) remaining
Completed 491.9 MiB/662.3 MiB (1.2 MiB/s) with 165 file(s) remaining
Completed 492.8 MiB/662.3 MiB (1.2 MiB/s) with 164 file(s) remaining
Completed 493.6 MiB/662.3 MiB (1.3 MiB/s) with 163 file(s) remaining
Completed 494.2 MiB/662.3 MiB (1.3 MiB/s) with 162 file(s) remaining
Completed 495.5 MiB/662.3 MiB (1.3 MiB/s) with 161 file(s) remaining
Completed 498.0 MiB/662.3 MiB (1.3 MiB/s) with 160 file(s) remaining
Completed 501.0 MiB/662.3 MiB (1.3 MiB/s) with 159 file(s) remaining
Completed 502.0 MiB/662.3 MiB (1.2 MiB/s) with 158 file(s) remaining
Completed 503.1 MiB/662.3 MiB (1.3 MiB/s) with 157 file(s) remaining
Completed 504.3 MiB/662.3 MiB (1.2 MiB/s) with 156 file(s) remaining
Completed 504.3 MiB/662.3 MiB (1.2 MiB/s) with 155 file(s) remaining
Completed 505.6 MiB/662.3 MiB (1.2 MiB/s) with 154 file(s) remaining
Completed 505.7 MiB/662.3 MiB (1.2 MiB/s) with 153 file(s) remaining
Completed 507.0 MiB/662.3 MiB (1.2 MiB/s) with 152 file(s) remaining
Completed 507.5 MiB/662.3 MiB (1.2 MiB/s) with 151 file(s) remaining
Completed 507.9 MiB/662.3 MiB (1.2 MiB/s) with 150 file(s) remaining
Completed 512.2 MiB/662.3 MiB (1.3 MiB/s) with 149 file(s) remaining
Completed 513.2 MiB/662.3 MiB (1.3 MiB/s) with 148 file(s) remaining
Completed 515.1 MiB/662.3 MiB (1.3 MiB/s) with 147 file(s) remaining
Completed 516.5 MiB/662.3 MiB (1.2 MiB/s) with 146 file(s) remaining
Completed 517.8 MiB/662.3 MiB (1.2 MiB/s) with 145 file(s) remaining
Completed 518.5 MiB/662.3 MiB (1.2 MiB/s) with 144 file(s) remaining
Completed 518.8 MiB/662.3 MiB (1.2 MiB/s) with 143 file(s) remaining
Completed 520.5 MiB/662.3 MiB (1.2 MiB/s) with 142 file(s) remaining
Completed 522.1 MiB/662.3 MiB (1.3 MiB/s) with 141 file(s) remaining
Completed 523.1 MiB/662.3 MiB (1.3 MiB/s) with 140 file(s) remaining
Completed 524.8 MiB/662.3 MiB (1.3 MiB/s) with 139 file(s) remaining
Completed 529.1 MiB/662.3 MiB (1.3 MiB/s) with 138 file(s) remaining
Completed 530.4 MiB/662.3 MiB (1.2 MiB/s) with 137 file(s) remaining
Completed 531.2 MiB/662.3 MiB (1.2 MiB/s) with 136 file(s) remaining
Completed 532.7 MiB/662.3 MiB (1.2 MiB/s) with 135 file(s) remaining
Completed 533.2 MiB/662.3 MiB (1.2 MiB/s) with 134 file(s) remaining
Completed 533.8 MiB/662.3 MiB (1.2 MiB/s) with 133 file(s) remaining
Completed 534.7 MiB/662.3 MiB (1.2 MiB/s) with 132 file(s) remaining
Completed 535.4 MiB/662.3 MiB (1.2 MiB/s) with 131 file(s) remaining
Completed 536.3 MiB/662.3 MiB (1.2 MiB/s) with 130 file(s) remaining
Completed 537.3 MiB/662.3 MiB (1.2 MiB/s) with 129 file(s) remaining
Completed 538.1 MiB/662.3 MiB (1.2 MiB/s) with 128 file(s) remaining
Completed 539.6 MiB/662.3 MiB (1.2 MiB/s) with 127 file(s) remaining
Completed 540.6 MiB/662.3 MiB (1.2 MiB/s) with 126 file(s) remaining
Completed 541.7 MiB/662.3 MiB (1.2 MiB/s) with 125 file(s) remaining
Completed 542.4 MiB/662.3 MiB (1.2 MiB/s) with 124 file(s) remaining
Completed 543.3 MiB/662.3 MiB (1.2 MiB/s) with 123 file(s) remaining
Completed 543.3 MiB/662.3 MiB (1.2 MiB/s) with 122 file(s) remaining
Completed 544.8 MiB/662.3 MiB (1.2 MiB/s) with 121 file(s) remaining
Completed 545.4 MiB/662.3 MiB (1.2 MiB/s) with 120 file(s) remaining
Completed 546.1 MiB/662.3 MiB (1.2 MiB/s) with 119 file(s) remaining
Completed 546.8 MiB/662.3 MiB (1.2 MiB/s) with 118 file(s) remaining
Completed 547.9 MiB/662.3 MiB (1.2 MiB/s) with 117 file(s) remaining
Completed 548.8 MiB/662.3 MiB (1.2 MiB/s) with 116 file(s) remaining
Completed 549.9 MiB/662.3 MiB (1.2 MiB/s) with 115 file(s) remaining
Completed 550.8 MiB/662.3 MiB (1.2 MiB/s) with 114 file(s) remaining
Completed 552.0 MiB/662.3 MiB (1.2 MiB/s) with 113 file(s) remaining
Completed 552.8 MiB/662.3 MiB (1.2 MiB/s) with 112 file(s) remaining
Completed 553.4 MiB/662.3 MiB (1.2 MiB/s) with 111 file(s) remaining
Completed 554.3 MiB/662.3 MiB (1.2 MiB/s) with 110 file(s) remaining
Completed 555.0 MiB/662.3 MiB (1.2 MiB/s) with 109 file(s) remaining
Completed 555.9 MiB/662.3 MiB (1.2 MiB/s) with 108 file(s) remaining
Completed 556.4 MiB/662.3 MiB (1.2 MiB/s) with 107 file(s) remaining
Completed 557.5 MiB/662.3 MiB (1.2 MiB/s) with 106 file(s) remaining
Completed 558.1 MiB/662.3 MiB (1.2 MiB/s) with 105 file(s) remaining
Completed 559.0 MiB/662.3 MiB (1.2 MiB/s) with 104 file(s) remaining
Completed 560.0 MiB/662.3 MiB (1.2 MiB/s) with 103 file(s) remaining
Completed 560.5 MiB/662.3 MiB (1.2 MiB/s) with 102 file(s) remaining
Completed 561.1 MiB/662.3 MiB (1.2 MiB/s) with 101 file(s) remaining
Completed 561.9 MiB/662.3 MiB (1.2 MiB/s) with 100 file(s) remaining
Completed 562.7 MiB/662.3 MiB (1.2 MiB/s) with 99 file(s) remaining
Completed 563.7 MiB/662.3 MiB (1.2 MiB/s) with 98 file(s) remaining
Completed 564.6 MiB/662.3 MiB (1.2 MiB/s) with 97 file(s) remaining
Completed 565.8 MiB/662.3 MiB (1.2 MiB/s) with 96 file(s) remaining
Completed 566.9 MiB/662.3 MiB (1.2 MiB/s) with 95 file(s) remaining
Completed 567.5 MiB/662.3 MiB (1.2 MiB/s) with 94 file(s) remaining
Completed 568.1 MiB/662.3 MiB (1.2 MiB/s) with 93 file(s) remaining
Completed 570.1 MiB/662.3 MiB (1.3 MiB/s) with 92 file(s) remaining
Completed 572.0 MiB/662.3 MiB (1.2 MiB/s) with 91 file(s) remaining
Completed 572.9 MiB/662.3 MiB (1.2 MiB/s) with 90 file(s) remaining
Completed 574.3 MiB/662.3 MiB (1.3 MiB/s) with 89 file(s) remaining
Completed 575.5 MiB/662.3 MiB (1.3 MiB/s) with 88 file(s) remaining
Completed 576.6 MiB/662.3 MiB (1.2 MiB/s) with 87 file(s) remaining
Completed 578.2 MiB/662.3 MiB (1.2 MiB/s) with 86 file(s) remaining
Completed 579.2 MiB/662.3 MiB (1.2 MiB/s) with 85 file(s) remaining
Completed 579.9 MiB/662.3 MiB (1.2 MiB/s) with 84 file(s) remaining
Completed 580.5 MiB/662.3 MiB (1.2 MiB/s) with 83 file(s) remaining
Completed 580.6 MiB/662.3 MiB (1.2 MiB/s) with 82 file(s) remaining
Completed 581.4 MiB/662.3 MiB (1.2 MiB/s) with 81 file(s) remaining
Completed 581.5 MiB/662.3 MiB (1.2 MiB/s) with 80 file(s) remaining
Completed 583.3 MiB/662.3 MiB (1.2 MiB/s) with 79 file(s) remaining
Completed 584.4 MiB/662.3 MiB (1.2 MiB/s) with 78 file(s) remaining
Completed 586.3 MiB/662.3 MiB (1.2 MiB/s) with 77 file(s) remaining
Completed 587.4 MiB/662.3 MiB (1.2 MiB/s) with 76 file(s) remaining
Completed 588.0 MiB/662.3 MiB (1.2 MiB/s) with 75 file(s) remaining
Completed 588.9 MiB/662.3 MiB (1.2 MiB/s) with 74 file(s) remaining
Completed 589.4 MiB/662.3 MiB (1.2 MiB/s) with 73 file(s) remaining
Completed 589.7 MiB/662.3 MiB (1.2 MiB/s) with 72 file(s) remaining
Completed 592.0 MiB/662.3 MiB (1.2 MiB/s) with 71 file(s) remaining
Completed 594.7 MiB/662.3 MiB (1.2 MiB/s) with 70 file(s) remaining
Completed 594.9 MiB/662.3 MiB (1.2 MiB/s) with 69 file(s) remaining
Completed 598.0 MiB/662.3 MiB (1.2 MiB/s) with 68 file(s) remaining
Completed 600.7 MiB/662.3 MiB (1.2 MiB/s) with 67 file(s) remaining
Completed 601.2 MiB/662.3 MiB (1.2 MiB/s) with 66 file(s) remaining
Completed 602.3 MiB/662.3 MiB (1.2 MiB/s) with 65 file(s) remaining
Completed 602.8 MiB/662.3 MiB (1.2 MiB/s) with 64 file(s) remaining
Completed 605.1 MiB/662.3 MiB (1.2 MiB/s) with 63 file(s) remaining
Completed 605.2 MiB/662.3 MiB (1.2 MiB/s) with 62 file(s) remaining
Completed 608.1 MiB/662.3 MiB (1.2 MiB/s) with 61 file(s) remaining
Completed 608.6 MiB/662.3 MiB (1.2 MiB/s) with 60 file(s) remaining
Completed 609.4 MiB/662.3 MiB (1.2 MiB/s) with 59 file(s) remaining
Completed 610.8 MiB/662.3 MiB (1.2 MiB/s) with 58 file(s) remaining
Completed 612.4 MiB/662.3 MiB (1.2 MiB/s) with 57 file(s) remaining
Completed 612.9 MiB/662.3 MiB (1.2 MiB/s) with 56 file(s) remaining
Completed 614.3 MiB/662.3 MiB (1.2 MiB/s) with 55 file(s) remaining
Completed 616.0 MiB/662.3 MiB (1.2 MiB/s) with 54 file(s) remaining
Completed 617.7 MiB/662.3 MiB (1.2 MiB/s) with 53 file(s) remaining
Completed 618.5 MiB/662.3 MiB (1.2 MiB/s) with 52 file(s) remaining
Completed 619.6 MiB/662.3 MiB (1.2 MiB/s) with 51 file(s) remaining
Completed 622.0 MiB/662.3 MiB (1.2 MiB/s) with 50 file(s) remaining
Completed 624.1 MiB/662.3 MiB (1.2 MiB/s) with 49 file(s) remaining
Completed 624.8 MiB/662.3 MiB (1.2 MiB/s) with 48 file(s) remaining
Completed 626.3 MiB/662.3 MiB (1.2 MiB/s) with 47 file(s) remaining
Completed 627.3 MiB/662.3 MiB (1.2 MiB/s) with 46 file(s) remaining
Completed 627.8 MiB/662.3 MiB (1.2 MiB/s) with 45 file(s) remaining
Completed 628.7 MiB/662.3 MiB (1.2 MiB/s) with 44 file(s) remaining
Completed 630.2 MiB/662.3 MiB (1.2 MiB/s) with 43 file(s) remaining
Completed 631.5 MiB/662.3 MiB (1.2 MiB/s) with 42 file(s) remaining
Completed 633.2 MiB/662.3 MiB (1.2 MiB/s) with 41 file(s) remaining
Completed 633.8 MiB/662.3 MiB (1.2 MiB/s) with 40 file(s) remaining
Completed 636.9 MiB/662.3 MiB (1.2 MiB/s) with 39 file(s) remaining
Completed 638.4 MiB/662.3 MiB (1.2 MiB/s) with 38 file(s) remaining
Completed 639.1 MiB/662.3 MiB (1.2 MiB/s) with 37 file(s) remaining
Completed 640.2 MiB/662.3 MiB (1.2 MiB/s) with 36 file(s) remaining
Completed 641.3 MiB/662.3 MiB (1.2 MiB/s) with 35 file(s) remaining
Completed 642.4 MiB/662.3 MiB (1.2 MiB/s) with 34 file(s) remaining
Completed 643.3 MiB/662.3 MiB (1.2 MiB/s) with 33 file(s) remaining
Completed 644.0 MiB/662.3 MiB (1.2 MiB/s) with 32 file(s) remaining
Completed 644.4 MiB/662.3 MiB (1.2 MiB/s) with 31 file(s) remaining
Completed 644.5 MiB/662.3 MiB (1.2 MiB/s) with 30 file(s) remaining
Completed 644.6 MiB/662.3 MiB (1.2 MiB/s) with 29 file(s) remaining
Completed 644.7 MiB/662.3 MiB (1.2 MiB/s) with 28 file(s) remaining
Completed 645.1 MiB/662.3 MiB (1.2 MiB/s) with 27 file(s) remaining
Completed 645.8 MiB/662.3 MiB (1.2 MiB/s) with 26 file(s) remaining
Completed 646.5 MiB/662.3 MiB (1.2 MiB/s) with 25 file(s) remaining
Completed 647.0 MiB/662.3 MiB (1.2 MiB/s) with 24 file(s) remaining
Completed 648.0 MiB/662.3 MiB (1.2 MiB/s) with 23 file(s) remaining
Completed 648.9 MiB/662.3 MiB (1.2 MiB/s) with 22 file(s) remaining
Completed 649.3 MiB/662.3 MiB (1.2 MiB/s) with 21 file(s) remaining
Completed 651.0 MiB/662.3 MiB (1.2 MiB/s) with 20 file(s) remaining
Completed 651.9 MiB/662.3 MiB (1.2 MiB/s) with 19 file(s) remaining
Completed 653.6 MiB/662.3 MiB (1.2 MiB/s) with 18 file(s) remaining
Completed 654.5 MiB/662.3 MiB (1.2 MiB/s) with 17 file(s) remaining
Completed 655.6 MiB/662.3 MiB (1.2 MiB/s) with 16 file(s) remaining
Completed 657.1 MiB/662.3 MiB (1.2 MiB/s) with 15 file(s) remaining
Completed 658.0 MiB/662.3 MiB (1.2 MiB/s) with 14 file(s) remaining
Completed 658.4 MiB/662.3 MiB (1.2 MiB/s) with 13 file(s) remaining
Completed 658.6 MiB/662.3 MiB (1.2 MiB/s) with 12 file(s) remaining
Completed 659.8 MiB/662.3 MiB (1.2 MiB/s) with 11 file(s) remaining
Completed 659.9 MiB/662.3 MiB (1.2 MiB/s) with 10 file(s) remaining
Completed 659.9 MiB/662.3 MiB (1.2 MiB/s) with 9 file(s) remaining
Completed 659.9 MiB/662.3 MiB (1.2 MiB/s) with 8 file(s) remaining
Completed 660.3 MiB/662.3 MiB (1.2 MiB/s) with 7 file(s) remaining
Completed 660.7 MiB/662.3 MiB (1.2 MiB/s) with 6 file(s) remaining
Completed 660.7 MiB/662.3 MiB (1.2 MiB/s) with 5 file(s) remaining
Completed 660.8 MiB/662.3 MiB (1.2 MiB/s) with 4 file(s) remaining
Completed 661.8 MiB/662.3 MiB (1.2 MiB/s) with 3 file(s) remaining
Completed 662.1 MiB/662.3 MiB (1.2 MiB/s) with 2 file(s) remaining
Completed 662.1 MiB/662.3 MiB (1.2 MiB/s) with 1 file(s) remaining

bundler: failed to load command: rails (/usr/local/bundle/bin/rails)

docker-compose.yml

    volumes:
      - .:/myapp
      - ~/storage:/storage
      - bundle_path:/bundle
    environment:
      - BUNDLE_PATH=/bundle/vendor
volumes:
  bundle_path:

% docker-compose up

sidekiq_1  | bundler: failed to load command: sidekiq (/usr/local/bundle/bin/sidekiq)
sidekiq_1  | /usr/local/lib/ruby/site_ruby/3.1.0/bundler/definition.rb:481:in `materialize': Could not find rails-6.1.5, pg-1.3.4, puma-4.3.11, sass-rails-6.0.0, webpacker-4.3.0, turbolinks-5.2.1, jbuilder-2.11.5, bootsnap-1.11.1, byebug-11.1.3, web-console-4.2.0, listen-3.7.1, spring-2.1.1, spring-watcher-listen-2.0.1, rename-1.0.8, devise-4.8.1, kaminari-1.2.2, foreman-0.87.2, redis-4.6.0, redis-namespace-1.8.2, sidekiq-6.4.1, rspec-rails-5.1.1, rspec-sidekiq-3.1.0, database_cleaner-2.0.1, factory_bot_rails-6.2.0, faker-2.20.0, aws-sdk-s3-1.113.0, nokogiri-1.13.3-aarch64-linux, actioncable-6.1.5, actionmailbox-6.1.5, actionmailer-6.1.5, actionpack-6.1.5, actiontext-6.1.5, actionview-6.1.5, activejob-6.1.5, activemodel-6.1.5, activerecord-6.1.5, activestorage-6.1.5, activesupport-6.1.5, railties-6.1.5, sprockets-rails-3.4.2, nio4r-2.5.8, sassc-rails-2.1.2, rack-proxy-0.7.2, turbolinks-source-5.2.0, msgpack-1.4.5, bindex-0.8.1, rb-fsevent-0.11.1, rb-inotify-0.10.1, thor-1.2.1, bcrypt-3.1.16, orm_adapter-0.5.0, responders-3.0.1, warden-1.2.9, kaminari-actionview-1.2.2, kaminari-activerecord-1.2.2, kaminari-core-1.2.2, connection_pool-2.2.5, rack-2.2.3, rspec-core-3.11.0, rspec-expectations-3.11.0, rspec-mocks-3.11.0, rspec-support-3.11.0, database_cleaner-active_record-2.0.1, factory_bot-6.2.0, i18n-1.10.0, aws-sdk-core-3.130.0, aws-sdk-kms-1.55.0, aws-sigv4-1.4.0, websocket-driver-0.7.5, mail-2.7.1, rails-dom-testing-2.0.3, rack-test-1.1.0, rails-html-sanitizer-1.4.2, builder-3.2.4, erubi-1.10.0, globalid-1.0.0, marcel-1.0.2, mini_mime-1.1.2, concurrent-ruby-1.1.9, minitest-5.15.0, tzinfo-2.0.4, zeitwerk-2.5.4, method_source-1.0.0, rake-13.0.6, sprockets-4.0.3, sassc-2.4.0, tilt-2.0.10, ffi-1.15.5, diff-lcs-1.5.0, database_cleaner-core-2.0.1, aws-eventstream-1.2.0, aws-partitions-1.566.0, jmespath-1.6.1, websocket-extensions-0.1.5, loofah-2.14.0, crass-1.0.6 in any of the sources (Bundler::GemNotFound)
sidekiq_1  | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/definition.rb:190:in `specs'
sidekiq_1  | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/definition.rb:238:in `specs_for'
sidekiq_1  | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/runtime.rb:18:in `setup'
sidekiq_1  | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler.rb:151:in `setup'
sidekiq_1  | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/setup.rb:20:in `block in <top (required)>'
sidekiq_1  | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/ui/shell.rb:136:in `with_level'
sidekiq_1  | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/ui/shell.rb:88:in `silence'
sidekiq_1  | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/setup.rb:20:in `<top (required)>'
sidekiq_1  | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/cli/exec.rb:56:in `require_relative'
sidekiq_1  | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/cli/exec.rb:56:in `kernel_load'
sidekiq_1  | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/cli/exec.rb:23:in `run'
sidekiq_1  | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/cli.rb:483:in `exec'
sidekiq_1  | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/vendor/thor/lib/thor/command.rb:27:in `run'
sidekiq_1  | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/vendor/thor/lib/thor/invocation.rb:127:in `invoke_command'
sidekiq_1  | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/vendor/thor/lib/thor.rb:392:in `dispatch'
sidekiq_1  | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/cli.rb:31:in `dispatch'
sidekiq_1  | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/vendor/thor/lib/thor/base.rb:485:in `start'
sidekiq_1  | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/cli.rb:25:in `start'
sidekiq_1  | 	from /usr/local/lib/ruby/gems/3.1.0/gems/bundler-2.3.9/exe/bundle:48:in `block in <top (required)>'
sidekiq_1  | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/friendly_errors.rb:103:in `with_friendly_errors'
sidekiq_1  | 	from /usr/local/lib/ruby/gems/3.1.0/gems/bundler-2.3.9/exe/bundle:36:in `<top (required)>'
sidekiq_1  | 	from /usr/local/bin/bundle:25:in `load'
sidekiq_1  | 	from /usr/local/bin/bundle:25:in `<main>'
cw-ovp_sidekiq_1 exited with code 1
web_1      | bundler: failed to load command: rails (/usr/local/bundle/bin/rails)
web_1      | /usr/local/lib/ruby/site_ruby/3.1.0/bundler/definition.rb:481:in `materialize': Could not find rails-6.1.5, pg-1.3.4, puma-4.3.11, sass-rails-6.0.0, webpacker-4.3.0, turbolinks-5.2.1, jbuilder-2.11.5, bootsnap-1.11.1, byebug-11.1.3, web-console-4.2.0, listen-3.7.1, spring-2.1.1, spring-watcher-listen-2.0.1, rename-1.0.8, devise-4.8.1, kaminari-1.2.2, foreman-0.87.2, redis-4.6.0, redis-namespace-1.8.2, sidekiq-6.4.1, rspec-rails-5.1.1, rspec-sidekiq-3.1.0, database_cleaner-2.0.1, factory_bot_rails-6.2.0, faker-2.20.0, aws-sdk-s3-1.113.0, nokogiri-1.13.3-aarch64-linux, actioncable-6.1.5, actionmailbox-6.1.5, actionmailer-6.1.5, actionpack-6.1.5, actiontext-6.1.5, actionview-6.1.5, activejob-6.1.5, activemodel-6.1.5, activerecord-6.1.5, activestorage-6.1.5, activesupport-6.1.5, railties-6.1.5, sprockets-rails-3.4.2, nio4r-2.5.8, sassc-rails-2.1.2, rack-proxy-0.7.2, turbolinks-source-5.2.0, msgpack-1.4.5, bindex-0.8.1, rb-fsevent-0.11.1, rb-inotify-0.10.1, thor-1.2.1, bcrypt-3.1.16, orm_adapter-0.5.0, responders-3.0.1, warden-1.2.9, kaminari-actionview-1.2.2, kaminari-activerecord-1.2.2, kaminari-core-1.2.2, connection_pool-2.2.5, rack-2.2.3, rspec-core-3.11.0, rspec-expectations-3.11.0, rspec-mocks-3.11.0, rspec-support-3.11.0, database_cleaner-active_record-2.0.1, factory_bot-6.2.0, i18n-1.10.0, aws-sdk-core-3.130.0, aws-sdk-kms-1.55.0, aws-sigv4-1.4.0, websocket-driver-0.7.5, mail-2.7.1, rails-dom-testing-2.0.3, rack-test-1.1.0, rails-html-sanitizer-1.4.2, builder-3.2.4, erubi-1.10.0, globalid-1.0.0, marcel-1.0.2, mini_mime-1.1.2, concurrent-ruby-1.1.9, minitest-5.15.0, tzinfo-2.0.4, zeitwerk-2.5.4, method_source-1.0.0, rake-13.0.6, sprockets-4.0.3, sassc-2.4.0, tilt-2.0.10, ffi-1.15.5, diff-lcs-1.5.0, database_cleaner-core-2.0.1, aws-eventstream-1.2.0, aws-partitions-1.566.0, jmespath-1.6.1, websocket-extensions-0.1.5, loofah-2.14.0, crass-1.0.6 in any of the sources (Bundler::GemNotFound)
web_1      | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/definition.rb:190:in `specs'
web_1      | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/definition.rb:238:in `specs_for'
web_1      | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/runtime.rb:18:in `setup'
web_1      | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler.rb:151:in `setup'
web_1      | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/setup.rb:20:in `block in <top (required)>'
web_1      | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/ui/shell.rb:136:in `with_level'
web_1      | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/ui/shell.rb:88:in `silence'
web_1      | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/setup.rb:20:in `<top (required)>'
web_1      | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/cli/exec.rb:56:in `require_relative'
web_1      | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/cli/exec.rb:56:in `kernel_load'
web_1      | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/cli/exec.rb:23:in `run'
web_1      | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/cli.rb:483:in `exec'
web_1      | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/vendor/thor/lib/thor/command.rb:27:in `run'
web_1      | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/vendor/thor/lib/thor/invocation.rb:127:in `invoke_command'
web_1      | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/vendor/thor/lib/thor.rb:392:in `dispatch'
web_1      | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/cli.rb:31:in `dispatch'
web_1      | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/vendor/thor/lib/thor/base.rb:485:in `start'
web_1      | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/cli.rb:25:in `start'
web_1      | 	from /usr/local/lib/ruby/gems/3.1.0/gems/bundler-2.3.9/exe/bundle:48:in `block in <top (required)>'
web_1      | 	from /usr/local/lib/ruby/site_ruby/3.1.0/bundler/friendly_errors.rb:103:in `with_friendly_errors'
web_1      | 	from /usr/local/lib/ruby/gems/3.1.0/gems/bundler-2.3.9/exe/bundle:36:in `<top (required)>'
web_1      | 	from /usr/local/bin/bundle:25:in `load'
web_1      | 	from /usr/local/bin/bundle:25:in `<main>'
cw-ovp_web_1 exited with code 1

duplicated build web and sidekiq in docker-compose

we have web, sidekiq in docker-compose. and they are same source but duplicated build when docker-compose build

% docker-compose up --build
Building app
[+] Building 87.5s (25/25) FINISHED                                                                                                                                                                                                                  
 => [internal] load build definition from Dockerfile                                                                                                                                                                                            0.0s
 => => transferring dockerfile: 37B                                                                                                                                                                                                             0.0s
 => [internal] load .dockerignore                                                                                                                                                                                                               0.0s
 => => transferring context: 34B                                                                                                                                                                                                                0.0s
 => [internal] load metadata for docker.io/library/ruby:3.0.0                                                                                                                                                                                   0.5s
 => [internal] load build context                                                                                                                                                                                                               2.4s
 => => transferring context: 42.24MB                                                                                                                                                                                                            2.4s
 => [ 1/20] FROM docker.io/library/ruby:3.0.0@sha256:c74394d0a4a05a3068ca9d0c53c36d451e27773264b568ae16ae24be9ad5621d                                                                                                                           0.0s
 => CACHED [ 2/20] RUN curl -sL https://deb.nodesource.com/setup_16.x | bash -                                                                                                                                                                  0.0s
 => CACHED [ 3/20] RUN wget https://dl.yarnpkg.com/debian/pubkey.gpg                                                                                                                                                                            0.0s
 => CACHED [ 4/20] RUN curl https://deb.nodesource.com/setup_12.x | bash                                                                                                                                                                        0.0s
 => CACHED [ 5/20] RUN cat pubkey.gpg | apt-key add -                                                                                                                                                                                           0.0s
 => CACHED [ 6/20] RUN echo "deb https://dl.yarnpkg.com/debian/ stable main" | tee /etc/apt/sources.list.d/yarn.list                                                                                                                            0.0s
 => CACHED [ 7/20] RUN apt-get update && apt-get install -y build-essential nodejs yarn vim libpq-dev postgresql-client ffmpeg                                                                                                                  0.0s
 => CACHED [ 8/20] RUN rm pubkey.gpg                                                                                                                                                                                                            0.0s
 => CACHED [ 9/20] RUN apt-get update &&     apt-get install -y         python3         python3-pip         python3-setuptools         groff         less     && pip3 install --upgrade pip     && apt-get clean                                0.0s
 => CACHED [10/20] RUN pip3 --no-cache-dir install --upgrade awscli                                                                                                                                                                             0.0s
 => CACHED [11/20] RUN mkdir /myapp                                                                                                                                                                                                             0.0s
 => CACHED [12/20] RUN mkdir /storage                                                                                                                                                                                                           0.0s
 => CACHED [13/20] WORKDIR /myapp                                                                                                                                                                                                               0.0s
 => [14/20] COPY . /myapp                                                                                                                                                                                                                       5.3s
 => [15/20] RUN gem update --system                                                                                                                                                                                                             3.5s
 => [16/20] RUN bundle check || bundle install --jobs 4                                                                                                                                                                                        66.1s 
 => [17/20] RUN yarn install --check-files                                                                                                                                                                                                      3.2s 
 => [18/20] RUN if [ "$RAILS_MASTER_KEY" ] ; then RAILS_MASTER_KEY=${RAILS_MASTER_KEY} RAILS_ENV=production bundle exec rails assets:precompile ; fi                                                                                            0.2s 
 => [19/20] COPY entrypoint.sh /usr/bin/                                                                                                                                                                                                        0.0s 
 => [20/20] RUN chmod +x /usr/bin/entrypoint.sh                                                                                                                                                                                                 0.2s 
 => exporting to image                                                                                                                                                                                                                          6.0s 
 => => exporting layers                                                                                                                                                                                                                         6.0s 
 => => writing image sha256:9bb55bf20e7c9a44ab20b86d1c435dd44d4b37054590e402b4b3c3e9c2c4f0ed                                                                                                                                                    0.0s
 => => naming to docker.io/library/cw-ovp_app                                                                                                                                                                                                   0.0s
Building sidekiq
[+] Building 92.9s (25/25) FINISHED                                                                                                                                                                                                                  
 => [internal] load build definition from Dockerfile                                                                                                                                                                                            0.0s
 => => transferring dockerfile: 37B                                                                                                                                                                                                             0.0s
 => [internal] load .dockerignore                                                                                                                                                                                                               0.0s
 => => transferring context: 34B                                                                                                                                                                                                                0.0s
 => [internal] load metadata for docker.io/library/ruby:3.0.0                                                                                                                                                                                   1.0s
 => [internal] load build context                                                                                                                                                                                                               1.2s
 => => transferring context: 2.66MB                                                                                                                                                                                                             1.1s
 => [ 1/20] FROM docker.io/library/ruby:3.0.0@sha256:c74394d0a4a05a3068ca9d0c53c36d451e27773264b568ae16ae24be9ad5621d                                                                                                                           0.0s
 => CACHED [ 2/20] RUN curl -sL https://deb.nodesource.com/setup_16.x | bash -                                                                                                                                                                  0.0s
 => CACHED [ 3/20] RUN wget https://dl.yarnpkg.com/debian/pubkey.gpg                                                                                                                                                                            0.0s
 => CACHED [ 4/20] RUN curl https://deb.nodesource.com/setup_12.x | bash                                                                                                                                                                        0.0s
 => CACHED [ 5/20] RUN cat pubkey.gpg | apt-key add -                                                                                                                                                                                           0.0s
 => CACHED [ 6/20] RUN echo "deb https://dl.yarnpkg.com/debian/ stable main" | tee /etc/apt/sources.list.d/yarn.list                                                                                                                            0.0s
 => CACHED [ 7/20] RUN apt-get update && apt-get install -y build-essential nodejs yarn vim libpq-dev postgresql-client ffmpeg                                                                                                                  0.0s
 => CACHED [ 8/20] RUN rm pubkey.gpg                                                                                                                                                                                                            0.0s
 => CACHED [ 9/20] RUN apt-get update &&     apt-get install -y         python3         python3-pip         python3-setuptools         groff         less     && pip3 install --upgrade pip     && apt-get clean                                0.0s
 => CACHED [10/20] RUN pip3 --no-cache-dir install --upgrade awscli                                                                                                                                                                             0.0s
 => CACHED [11/20] RUN mkdir /myapp                                                                                                                                                                                                             0.0s
 => CACHED [12/20] RUN mkdir /storage                                                                                                                                                                                                           0.0s
 => CACHED [13/20] WORKDIR /myapp                                                                                                                                                                                                               0.0s
 => [14/20] COPY . /myapp                                                                                                                                                                                                                       5.8s
 => [15/20] RUN gem update --system                                                                                                                                                                                                             3.6s
 => [16/20] RUN bundle check || bundle install --jobs 4                                                                                                                                                                                        71.6s 
 => [17/20] RUN yarn install --check-files                                                                                                                                                                                                      3.2s 
 => [18/20] RUN if [ "$RAILS_MASTER_KEY" ] ; then RAILS_MASTER_KEY=${RAILS_MASTER_KEY} RAILS_ENV=production bundle exec rails assets:precompile ; fi                                                                                            0.2s 
 => [19/20] COPY entrypoint.sh /usr/bin/                                                                                                                                                                                                        0.0s 
 => [20/20] RUN chmod +x /usr/bin/entrypoint.sh                                                                                                                                                                                                 0.2s 
 => exporting to image                                                                                                                                                                                                                          6.1s 
 => => exporting layers                                                                                                                                                                                                                         6.1s 
 => => writing image sha256:69830748caa3ef6a23611ab1039f92521d58f9669c7d91969188ebaabde6b088                                                                                                                                                    0.0s
 => => naming to docker.io/library/cw-ovp_sidekiq                                                                                                                                                                                               0.0s
cw-ovp_redis_1 is up-to-date
cw-ovp_db_1 is up-to-date
Recreating cw-ovp_app_1 ... done
Recreating cw-ovp_sidekiq_1 ... done

Video packaging job refactoring

Error fetching job: UNBLOCKED force unblock from blocking operation, instance state changed (master -> replica?)

CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:43:08.763Z pid=1 tid=gmo29afdp class=ThumbnailWorker jid=477de07d4ec15035dd8781fc INFO:  cp_thumbnail_to_cdn_cmd vod-hls 2020/11/12/22/thumbnail/10_00_00_38_000.png /storage/22_thumbnail/10_00_00_38_000.png
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:43:08.776Z pid=1 tid=gmo29afdp class=ThumbnailWorker jid=477de07d4ec15035dd8781fc elapsed=23.667 INFO: done
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.754Z pid=1 tid=gmo29afdp ERROR: Error fetching job: UNBLOCKED force unblock from blocking operation, instance state changed (master -> replica?)
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.755Z pid=1 tid=gmo29afdp WARN: Redis::CommandError: UNBLOCKED force unblock from blocking operation, instance state changed (master -> replica?)
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.755Z pid=1 tid=gmo29afdp WARN: /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:127:in `call'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:221:in `block in call_with_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:295:in `with_socket_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:220:in `call_with_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1224:in `block in _bpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:69:in `block in synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/lib/ruby/2.6.0/monitor.rb:230:in `mon_synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:69:in `synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1221:in `_bpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1266:in `brpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/fetch.rb:39:in `block in retrieve_work'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq.rb:98:in `block in redis'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:63:in `block (2 levels) in with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:62:in `handle_interrupt'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:62:in `block in with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:59:in `handle_interrupt'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:59:in `with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq.rb:95:in `redis'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/fetch.rb:39:in `retrieve_work'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:83:in `get_one'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:95:in `fetch'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:77:in `process_one'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:68:in `run'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:15:in `watchdog'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:24:in `block in safe_thread'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.755Z pid=1 tid=gmo29afjt ERROR: Error fetching job: UNBLOCKED force unblock from blocking operation, instance state changed (master -> replica?)
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.755Z pid=1 tid=gmo29afjt WARN: Redis::CommandError: UNBLOCKED force unblock from blocking operation, instance state changed (master -> replica?)
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.755Z pid=1 tid=gmo29afjt WARN: /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:127:in `call'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:221:in `block in call_with_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:295:in `with_socket_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:220:in `call_with_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1224:in `block in _bpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:69:in `block in synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/lib/ruby/2.6.0/monitor.rb:230:in `mon_synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:69:in `synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1221:in `_bpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1266:in `brpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/fetch.rb:39:in `block in retrieve_work'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq.rb:98:in `block in redis'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:63:in `block (2 levels) in with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:62:in `handle_interrupt'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:62:in `block in with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:59:in `handle_interrupt'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:59:in `with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq.rb:95:in `redis'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/fetch.rb:39:in `retrieve_work'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:83:in `get_one'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:95:in `fetch'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:77:in `process_one'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:68:in `run'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:15:in `watchdog'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:24:in `block in safe_thread'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.754Z pid=1 tid=gmo280z4p ERROR: Error fetching job: UNBLOCKED force unblock from blocking operation, instance state changed (master -> replica?)
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.755Z pid=1 tid=gmo280z4p WARN: Redis::CommandError: UNBLOCKED force unblock from blocking operation, instance state changed (master -> replica?)
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.756Z pid=1 tid=gmo280z4p WARN: /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:127:in `call'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:221:in `block in call_with_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:295:in `with_socket_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:220:in `call_with_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1224:in `block in _bpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:69:in `block in synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/lib/ruby/2.6.0/monitor.rb:230:in `mon_synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:69:in `synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1221:in `_bpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1266:in `brpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/fetch.rb:39:in `block in retrieve_work'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq.rb:98:in `block in redis'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:63:in `block (2 levels) in with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:62:in `handle_interrupt'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:62:in `block in with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:59:in `handle_interrupt'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:59:in `with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq.rb:95:in `redis'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/fetch.rb:39:in `retrieve_work'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:83:in `get_one'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:95:in `fetch'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:77:in `process_one'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:68:in `run'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:15:in `watchdog'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:24:in `block in safe_thread'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.755Z pid=1 tid=gmo280ysh ERROR: Error fetching job: UNBLOCKED force unblock from blocking operation, instance state changed (master -> replica?)
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.756Z pid=1 tid=gmo280ysh WARN: Redis::CommandError: UNBLOCKED force unblock from blocking operation, instance state changed (master -> replica?)
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.756Z pid=1 tid=gmo280ysh WARN: /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:127:in `call'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:221:in `block in call_with_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:295:in `with_socket_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:220:in `call_with_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1224:in `block in _bpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:69:in `block in synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/lib/ruby/2.6.0/monitor.rb:230:in `mon_synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:69:in `synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1221:in `_bpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1266:in `brpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/fetch.rb:39:in `block in retrieve_work'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq.rb:98:in `block in redis'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:63:in `block (2 levels) in with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:62:in `handle_interrupt'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:62:in `block in with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:59:in `handle_interrupt'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:59:in `with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq.rb:95:in `redis'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/fetch.rb:39:in `retrieve_work'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:83:in `get_one'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:95:in `fetch'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:77:in `process_one'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:68:in `run'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:15:in `watchdog'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:24:in `block in safe_thread'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.755Z pid=1 tid=gmo29af1h ERROR: Error fetching job: UNBLOCKED force unblock from blocking operation, instance state changed (master -> replica?)
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.756Z pid=1 tid=gmo29af1h WARN: Redis::CommandError: UNBLOCKED force unblock from blocking operation, instance state changed (master -> replica?)
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.757Z pid=1 tid=gmo29af1h WARN: /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:127:in `call'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:221:in `block in call_with_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:295:in `with_socket_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:220:in `call_with_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1224:in `block in _bpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:69:in `block in synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/lib/ruby/2.6.0/monitor.rb:230:in `mon_synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:69:in `synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1221:in `_bpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1266:in `brpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/fetch.rb:39:in `block in retrieve_work'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq.rb:98:in `block in redis'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:63:in `block (2 levels) in with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:62:in `handle_interrupt'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:62:in `block in with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:59:in `handle_interrupt'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:59:in `with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq.rb:95:in `redis'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/fetch.rb:39:in `retrieve_work'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:83:in `get_one'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:95:in `fetch'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:77:in `process_one'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:68:in `run'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:15:in `watchdog'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:24:in `block in safe_thread'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.755Z pid=1 tid=gmo29af7l ERROR: Error fetching job: UNBLOCKED force unblock from blocking operation, instance state changed (master -> replica?)
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.757Z pid=1 tid=gmo29af7l WARN: Redis::CommandError: UNBLOCKED force unblock from blocking operation, instance state changed (master -> replica?)
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.757Z pid=1 tid=gmo29af7l WARN: /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:127:in `call'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:221:in `block in call_with_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:295:in `with_socket_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:220:in `call_with_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1224:in `block in _bpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:69:in `block in synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/lib/ruby/2.6.0/monitor.rb:230:in `mon_synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:69:in `synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1221:in `_bpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1266:in `brpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/fetch.rb:39:in `block in retrieve_work'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq.rb:98:in `block in redis'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:63:in `block (2 levels) in with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:62:in `handle_interrupt'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:62:in `block in with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:59:in `handle_interrupt'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:59:in `with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq.rb:95:in `redis'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/fetch.rb:39:in `retrieve_work'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:83:in `get_one'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:95:in `fetch'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:77:in `process_one'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:68:in `run'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:15:in `watchdog'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:24:in `block in safe_thread'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.757Z pid=1 tid=gmo280yyl ERROR: Error fetching job: UNBLOCKED force unblock from blocking operation, instance state changed (master -> replica?)
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.757Z pid=1 tid=gmo280yyl WARN: Redis::CommandError: UNBLOCKED force unblock from blocking operation, instance state changed (master -> replica?)
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.757Z pid=1 tid=gmo280yyl WARN: /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:127:in `call'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:221:in `block in call_with_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:295:in `with_socket_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:220:in `call_with_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1224:in `block in _bpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:69:in `block in synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/lib/ruby/2.6.0/monitor.rb:230:in `mon_synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:69:in `synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1221:in `_bpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1266:in `brpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/fetch.rb:39:in `block in retrieve_work'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq.rb:98:in `block in redis'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:63:in `block (2 levels) in with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:62:in `handle_interrupt'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:62:in `block in with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:59:in `handle_interrupt'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:59:in `with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq.rb:95:in `redis'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/fetch.rb:39:in `retrieve_work'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:83:in `get_one'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:95:in `fetch'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:77:in `process_one'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:68:in `run'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:15:in `watchdog'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:24:in `block in safe_thread'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.758Z pid=1 tid=gmo29afpx ERROR: Error fetching job: UNBLOCKED force unblock from blocking operation, instance state changed (master -> replica?)
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.758Z pid=1 tid=gmo29afpx WARN: Redis::CommandError: UNBLOCKED force unblock from blocking operation, instance state changed (master -> replica?)
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.758Z pid=1 tid=gmo29afpx WARN: /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:127:in `call'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:221:in `block in call_with_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:295:in `with_socket_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:220:in `call_with_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1224:in `block in _bpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:69:in `block in synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/lib/ruby/2.6.0/monitor.rb:230:in `mon_synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:69:in `synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1221:in `_bpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1266:in `brpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/fetch.rb:39:in `block in retrieve_work'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq.rb:98:in `block in redis'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:63:in `block (2 levels) in with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:62:in `handle_interrupt'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:62:in `block in with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:59:in `handle_interrupt'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:59:in `with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq.rb:95:in `redis'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/fetch.rb:39:in `retrieve_work'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:83:in `get_one'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:95:in `fetch'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:77:in `process_one'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:68:in `run'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:15:in `watchdog'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:24:in `block in safe_thread'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.766Z pid=1 tid=gmo29aep9 ERROR: Error fetching job: UNBLOCKED force unblock from blocking operation, instance state changed (master -> replica?)
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.766Z pid=1 tid=gmo29aep9 WARN: Redis::CommandError: UNBLOCKED force unblock from blocking operation, instance state changed (master -> replica?)
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.766Z pid=1 tid=gmo29aep9 WARN: /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:127:in `call'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:221:in `block in call_with_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:295:in `with_socket_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:220:in `call_with_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1224:in `block in _bpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:69:in `block in synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/lib/ruby/2.6.0/monitor.rb:230:in `mon_synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:69:in `synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1221:in `_bpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1266:in `brpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/fetch.rb:39:in `block in retrieve_work'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq.rb:98:in `block in redis'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:63:in `block (2 levels) in with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:62:in `handle_interrupt'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:62:in `block in with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:59:in `handle_interrupt'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:59:in `with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq.rb:95:in `redis'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/fetch.rb:39:in `retrieve_work'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:83:in `get_one'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:95:in `fetch'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:77:in `process_one'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:68:in `run'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:15:in `watchdog'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:24:in `block in safe_thread'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.766Z pid=1 tid=gmo29aevd ERROR: Error fetching job: UNBLOCKED force unblock from blocking operation, instance state changed (master -> replica?)
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.766Z pid=1 tid=gmo29aevd WARN: Redis::CommandError: UNBLOCKED force unblock from blocking operation, instance state changed (master -> replica?)
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:26.766Z pid=1 tid=gmo29aevd WARN: /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:127:in `call'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:221:in `block in call_with_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:295:in `with_socket_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis/client.rb:220:in `call_with_timeout'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1224:in `block in _bpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:69:in `block in synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/lib/ruby/2.6.0/monitor.rb:230:in `mon_synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:69:in `synchronize'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1221:in `_bpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/redis-4.2.1/lib/redis.rb:1266:in `brpop'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/fetch.rb:39:in `block in retrieve_work'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq.rb:98:in `block in redis'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:63:in `block (2 levels) in with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:62:in `handle_interrupt'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:62:in `block in with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:59:in `handle_interrupt'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/connection_pool-2.2.3/lib/connection_pool.rb:59:in `with'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq.rb:95:in `redis'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/fetch.rb:39:in `retrieve_work'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:83:in `get_one'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:95:in `fetch'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:77:in `process_one'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/processor.rb:68:in `run'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:15:in `watchdog'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | /usr/local/bundle/ruby/2.6.0/gems/sidekiq-6.1.0/lib/sidekiq/util.rb:24:in `block in safe_thread'
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:31.366Z pid=1 tid=gmo280zi1 ERROR: heartbeat: READONLY You can't write against a read only replica.
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:36.856Z pid=1 tid=gmo29afjt INFO: Redis is online, 10.101205447106622 sec downtime
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:36.856Z pid=1 tid=gmo280yyl INFO: Redis is online, 10.09892669110559 sec downtime
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:36.858Z pid=1 tid=gmo29afdp INFO: Redis is online, 10.104536039987579 sec downtime
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:36.859Z pid=1 tid=gmo29aevd INFO: Redis is online, 10.092739504994825 sec downtime
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:36.856Z pid=1 tid=gmo29afpx INFO: Redis is online, 10.098559829988517 sec downtime
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:36.856Z pid=1 tid=gmo29af7l INFO: Redis is online, 10.101458562072366 sec downtime
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:36.857Z pid=1 tid=gmo280ysh INFO: Redis is online, 10.101731691975147 sec downtime
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:36.859Z pid=1 tid=gmo29aep9 INFO: Redis is online, 10.092762653017417 sec downtime
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:36.856Z pid=1 tid=gmo280z4p INFO: Redis is online, 10.102081213030033 sec downtime
CW-OVP_sidekiq.2.7bo7qn41qt07@aws-worker1    | 2020-11-12T05:48:36.856Z pid=1 tid=gmo29af1h INFO: Redis is online, 10.101761467987671 sec downtime
error from daemon in stream: Error grabbing logs: rpc error: code = Unknown desc = warning: incomplete log stream. some logs could not be retrieved for the following reasons: node ns3j1r7qgumbneet7i54ffu5n disconnected unexpectedly

installation

hi thanks for your work, you can install it without using the AWS S3 Storage

when multiple sidekiq run on multiple aws ec2, sidekiq not working that load uploaded file

when bultiple sidekiq on local mutiple node with docker-machine, it's working well
but it's not working on multiple server such as aws ec2.
because uploaded file use active storage that will delete file in local and send s3.
i will change code of upload file part.

Duplicated aws s3 command log

There is duplicated log
i will change regular expression for log extracting.
i used REX code of below for log extracting.

matched_time = line.to_s.match(/Completed .+ with (\d+) file.+ remaining/)

This of blow is log from aws s3 command

bash sample log

/Desktop/assets s3://vod-origin/assets --recursive
upload: ../../Desktop/assets/Screen Shot 2020-09-18 at 11.49.29 PM.png to s3://vod-origin/assets/Screen Shot 2020-09-18 at 11.49.29 PM.png
upload: ../../Desktop/assets/Screen Shot 2020-09-18 at 4.03.07 PM.png to s3://vod-origin/assets/Screen Shot 2020-09-18 at 4.03.07 PM.png
upload: ../../Desktop/assets/Screen Shot 2020-09-18 at 4.03.45 PM.png to s3://vod-origin/assets/Screen Shot 2020-09-18 at 4.03.45 PM.png

% aws s3 cp /Users/cw/Desktop/assets s3://vod-origin/assets --recursive
upload: ../../Desktop/assets/Screen Shot 2020-09-18 at 11.49.29 PM.png to s3://vod-origin/assets/Screen Shot 2020-09-18 at 11.49.29 PM.png
upload: ../../Desktop/assets/Screen Shot 2020-09-18 at 4.03.07 PM.png to s3://vod-origin/assets/Screen Shot 2020-09-18 at 4.03.07 PM.png
Completed 3.7 MiB/4.0 MiB (787.7 KiB/s) with 1 file(s) remaining Completed 3.7 MiB/4.0 MiB (787.7 KiB/s) with 1 file(s) remaining Completed 3.7 MiB/4.0 MiB (787.7 KiB/s) with 1 file(s) remaining

sidekiq log

move: ../storage/encode/2020/10/20/82/hls/480/480p_000.ts to s3://vod-hls/encode/2020/10/20/82/hls/480/480p_000.tss mv: Completed 286 Bytes/2.4 MiB (565 Bytes/s) with 117 file(s) remaining
move: ../storage/encode/2020/10/20/82/hls/1080/1080p_000.ts to s3://vod-hls/encode/2020/10/20/82/hls/1080/1080p_000.ts: Completed 369.5 KiB/2.4 MiB (5.9 KiB/s) with 6 file(s) remaining
move: ../storage/encode/2020/10/20/82/hls/playlist.m3u8 to s3://vod-hls/encode/2020/10/20/82/hls/playlist.m3u8: aws mv: Completed 1.5 MiB/2.4 MiB (12.4 KiB/s) with 5 file(s) remaining
move: ../storage/encode/2020/10/20/82/hls/360/360p_000.ts to s3://vod-hls/encode/2020/10/20/82/hls/360/360p_000.tss mv: Completed 1.5 MiB/2.4 MiB (12.2 KiB/s) with 4 file(s) remaining
move: ../storage/encode/2020/10/20/82/hls/720/720p_000.ts to s3://vod-hls/encode/2020/10/20/82/hls/720/720p_000.tss mv: Completed 1.7 MiB/2.4 MiB (8.4 KiB/s) with 3 file(s) remaining
move: ../storage/encode/2020/10/20/82/hls/1080/playlist.m3u8 to s3://vod-hls/encode/2020/10/20/82/hls/1080/playlist.m3u8Completed 2.4 MiB/2.4 MiB (11.1 KiB/s) with 2 file(s) remaining
sidekiq_1  | 2020-10-20T07:48:56.813Z pid=1 tid=gnzo3jafl class=EncodeWorker jid=0e5cea2687c8d6a370b6b54a INFO: aws mv: Completed 2.4 MiB/2.4 MiB (10.9 KiB/s) with 1 file(s) remaining

bug log

Completed 1.9 MiB/2.4 MiB (805.7 KiB/s) with 2 file(s) remaining Completed 2.1 MiB/2.4 MiB (862.5 KiB/s) with 2 file(s) remaining Completed 2.2 MiB/2.4 MiB (637.0 KiB/s) with 2 file(s) remaining

ERROR [ 2/14] RUN curl -sL https://deb.nodesource.com/setup_12.x | ba 2.7s

i tried update gem, yarn lib
but i got below message of error.
maybe Dockerfile has some problem

docker-compose run --no-deps web bundle update
docker-compose run --no-deps web yarn upgrade --latest

% docker-compose --env-file .env.dev.s3 up --build -d

Building web
[+] Building 3.2s (6/18)                                                        
 => [internal] load build definition from Dockerfile                       0.1s
 => => transferring dockerfile: 1.22kB                                     0.0s
 => [internal] load .dockerignore                                          0.0s
 => => transferring context: 83B                                           0.0s
 => [internal] load metadata for docker.io/library/ruby:2.6.3              0.0s
 => [ 1/14] FROM docker.io/library/ruby:2.6.3                              0.4s
 => CANCELED [internal] load build context                                 3.0s
 => => transferring context: 54.46MB                                       3.0s
 => ERROR [ 2/14] RUN curl -sL https://deb.nodesource.com/setup_12.x | ba  2.7s
------                                                                          
 > [ 2/14] RUN curl -sL https://deb.nodesource.com/setup_12.x | bash - &&     curl -sS https://dl.yarnpkg.com/debian/pubkey.gpg | apt-key add - &&     echo "deb https://dl.yarnpkg.com/debian/ stable main" | tee /etc/apt/sources.list.d/yarn.list &&     apt-get update &&     apt-get install -qq -y build-essential nodejs yarn vim     libpq-dev postgresql-client ffmpeg:                                
#5 1.145 
#5 1.145 ## Installing the NodeSource Node.js 12.x repo...
#5 1.145 
#5 1.155 
#5 1.155 ## Populating apt-get cache...
#5 1.155 
#5 1.155 + apt-get update
#5 1.398 Get:1 http://deb.debian.org/debian buster InRelease [122 kB]
#5 1.398 Get:2 http://security.debian.org/debian-security buster/updates InRelease [65.4 kB]
#5 1.454 Get:3 http://deb.debian.org/debian buster-updates InRelease [51.9 kB]
#5 1.619 Err:2 http://security.debian.org/debian-security buster/updates InRelease
#5 1.619   At least one invalid signature was encountered.
#5 1.797 Err:1 http://deb.debian.org/debian buster InRelease
#5 1.797   At least one invalid signature was encountered.
#5 1.956 Err:3 http://deb.debian.org/debian buster-updates InRelease
#5 1.956   At least one invalid signature was encountered.
#5 1.985 Reading package lists...
#5 2.030 W: GPG error: http://security.debian.org/debian-security buster/updates InRelease: At least one invalid signature was encountered.
#5 2.030 E: The repository 'http://security.debian.org/debian-security buster/updates InRelease' is not signed.
#5 2.030 W: GPG error: http://deb.debian.org/debian buster InRelease: At least one invalid signature was encountered.
#5 2.030 E: The repository 'http://deb.debian.org/debian buster InRelease' is not signed.
#5 2.030 W: GPG error: http://deb.debian.org/debian buster-updates InRelease: At least one invalid signature was encountered.
#5 2.030 E: The repository 'http://deb.debian.org/debian buster-updates InRelease' is not signed.
#5 2.031 Error executing command, exiting
------
executor failed running [/bin/sh -c curl -sL https://deb.nodesource.com/setup_12.x | bash - &&     curl -sS https://dl.yarnpkg.com/debian/pubkey.gpg | apt-key add - &&     echo "deb https://dl.yarnpkg.com/debian/ stable main" | tee /etc/apt/sources.list.d/yarn.list &&     apt-get update &&     apt-get install -qq -y build-essential nodejs yarn vim     libpq-dev postgresql-client ffmpeg]: exit code: 1
ERROR: Service 'web' failed to build : Build failed

Deprecated rpsec controller

TODO

Deleted spec/controller
Use rspec request instead controller
rspec/rspec-rails#1838

system test

we need system test with capybara.
https://guides.rubyonrails.org/testing.html#creating-articles-system-test
https://www.changwoo.org/[email protected]/2021-11-14/selenium-webdriver-firefox-67e9bc3a85

Error while opening encoder for output stream #2:0 - maybe incorrect parameters such as bit_rate, rate, width or height

[libx264 @ 0x7f8c2f820000] height not divisible by 2 (1280x719)
Error initializing output stream 2:0 -- Error while opening encoder for output stream #2:0 - maybe incorrect parameters such as bit_rate, rate, width or height
[aac @ 0x7f8c2f817400] Qavg: 64759.172
[aac @ 0x7f8c2f817400] 2 frames left in the queue on closing
[aac @ 0x7f8c2f81c600] Qavg: 65536.000
[aac @ 0x7f8c2f81c600] 2 frames left in the queue on closing
[aac @ 0x7f8c2f821800] Qavg: 65536.000
[aac @ 0x7f8c2f821800] 2 frames left in the queue on closing
[aac @ 0x7f8c2f826a00] Qavg: 65536.000
[aac @ 0x7f8c2f826a00] 2 frames left in the queue on closing

travis error

travis error after s3 config
there is no .env.dev.s3
i will create .env.dev.s3 file when "after" callback in .travis.yml

ActiveStorage::IntegrityError: ActiveStorage::IntegrityError

% docker-compose run --no-deps web bundle exec rspec --format documentation

Creating cw-ovp_web_run ... done

EncodesController
  GET #index
    returns a success response (FAILED - 1)
  GET #show
    returns a success response (FAILED - 2)
  GET #new
    returns a success response
  POST #create
    with valid params
      creates a new Encode
      redirects to the created encode
    with invalid params
      returns a success response (i.e. to display the 'new' template)

EncodesController
  routing
    routes to #index
    routes to #new
    routes to #show
    routes to #create

encodes/index
  renders a list of encodes (FAILED - 3)

encodes/new
  renders new encode form

encodes/show
  renders attributes in <p> (FAILED - 4)

Failures:

  1) EncodesController GET #index returns a success response
     Failure/Error: Encode.create! valid_attributes
     
     ActiveStorage::IntegrityError:
       ActiveStorage::IntegrityError
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/service/disk_service.rb:159:in `ensure_integrity_of'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/service/disk_service.rb:22:in `block in upload'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/service.rb:155:in `instrument'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/service/disk_service.rb:20:in `upload'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/app/models/active_storage/blob.rb:253:in `upload_without_unfurling'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/attached/changes/create_one.rb:26:in `upload'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/attached/model.rb:77:in `block in has_one_attached'
     # ./spec/controllers/encodes_controller_spec.rb:48:in `block (3 levels) in <top (required)>'

  2) EncodesController GET #show returns a success response
     Failure/Error: encode = Encode.create! valid_attributes
     
     ActiveStorage::IntegrityError:
       ActiveStorage::IntegrityError
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/service/disk_service.rb:159:in `ensure_integrity_of'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/service/disk_service.rb:22:in `block in upload'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/service.rb:155:in `instrument'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/service/disk_service.rb:20:in `upload'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/app/models/active_storage/blob.rb:253:in `upload_without_unfurling'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/attached/changes/create_one.rb:26:in `upload'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/attached/model.rb:77:in `block in has_one_attached'
     # ./spec/controllers/encodes_controller_spec.rb:56:in `block (3 levels) in <top (required)>'

  3) encodes/index renders a list of encodes
     Failure/Error: Encode.create!(title: "hello", user: @user, file: Rack::Test::UploadedFile.new(Rails.root.join("spec/factories/sample.mp4")))
     
     ActiveStorage::IntegrityError:
       ActiveStorage::IntegrityError
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/service/disk_service.rb:159:in `ensure_integrity_of'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/service/disk_service.rb:22:in `block in upload'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/service.rb:155:in `instrument'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/service/disk_service.rb:20:in `upload'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/app/models/active_storage/blob.rb:253:in `upload_without_unfurling'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/attached/changes/create_one.rb:26:in `upload'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/attached/model.rb:77:in `block in has_one_attached'
     # ./spec/views/encodes/index.html.erb_spec.rb:8:in `block (2 levels) in <main>'

  4) encodes/show renders attributes in <p>
     Failure/Error: @encode = assign(:encode, Encode.create!(title: @title, user: @user, file: Rack::Test::UploadedFile.new(Rails.root.join("spec/factories/sample.mp4"))))
     
     ActiveStorage::IntegrityError:
       ActiveStorage::IntegrityError
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/service/disk_service.rb:159:in `ensure_integrity_of'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/service/disk_service.rb:22:in `block in upload'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/service.rb:155:in `instrument'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/service/disk_service.rb:20:in `upload'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/app/models/active_storage/blob.rb:253:in `upload_without_unfurling'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/attached/changes/create_one.rb:26:in `upload'
     # /usr/local/bundle/ruby/2.6.0/gems/activestorage-6.1.4.1/lib/active_storage/attached/model.rb:77:in `block in has_one_attached'
     # ./spec/views/encodes/show.html.erb_spec.rb:7:in `block (2 levels) in <main>'

Finished in 8.5 seconds (files took 9.43 seconds to load)
13 examples, 4 failures

Failed examples:

rspec ./spec/controllers/encodes_controller_spec.rb:47 # EncodesController GET #index returns a success response
rspec ./spec/controllers/encodes_controller_spec.rb:55 # EncodesController GET #show returns a success response
rspec ./spec/views/encodes/index.html.erb_spec.rb:12 # encodes/index renders a list of encodes
rspec ./spec/views/encodes/show.html.erb_spec.rb:10 # encodes/show renders attributes in <p>

ERROR: 1

clustering for multiple sidekiq worker

i have a docker-compose.yml for single node of dev env.
but i need multiple node for sidekiq workers on production env.
i will make stack.yml for docker swarm config file and docker-machine script.

Timeout error when uploading large files to S3

I got an error when I'm trying to upload a file larger then 1MB
Error storing "file_example_MP4_480_1_5MG.mp4". Status: 0

I think I get a request timeout from S3
How can this be solved and support large files?