Very slowly publication and progress report

[pulp]

Very slowly publication and progress report

[pulpbot]

From: wilful (wilful)
Date: 2021-08-12T14:49:44Z

---

        {                                                                                                                                                               [159/1881]
            "architectures": "amd64",
            "ca_cert": null,
            "client_cert": null,
            "components": null,
            "connect_timeout": null,
            "distributions": "trusty trusty-backports trusty-proposed trusty-security trusty-updates focal focal-backports focal-proposed focal-security focal-updates",
            "download_concurrency": null,
            "gpgkey": null,
            "headers": null,
            "ignore_missing_package_indices": false,
            "max_retries": null,
            "name": "archive.ubuntu.com",
            "policy": "on_demand",
            "proxy_url": null,
            "pulp_created": "2021-08-12T06:57:21.826903Z",
            "pulp_href": "/pulp/api/v3/remotes/deb/apt/248db97b-b81a-4be2-9048-faf441b3dfaa/",
            "pulp_labels": {},
            "pulp_last_updated": "2021-08-12T06:57:21.826926Z",
            "rate_limit": null,
            "sock_connect_timeout": null,
            "sock_read_timeout": null,
            "sync_installer": false,
            "sync_sources": false,
            "sync_udebs": false,
            "tls_validation": true,
            "total_timeout": null,
            "url": "http://archive.ubuntu.com/ubuntu/"
        },

[pulpbot]

From: @quba42 (quba42)
Date: 2021-08-12T14:52:49Z

---

What publisher are you using with what options? And what is your goal. Synchronizing 10 large Ubuntu distributions into a single repository is about as resource intensive as it is possible to go and most likely untested.

[pulpbot]

From: wilful (wilful)
Date: 2021-08-12T15:02:24Z

---

Postgres starting only SELECT

postgres 124116 94.5  7.5 3829508 1234272 ?     Rs   07:50 407:09 postgres: pulp pulp 127.0.0.1(4810) SELECT

[pulpbot]

From: wilful (wilful)
Date: 2021-08-12T15:09:38Z

---

quba42 wrote:

What publisher are you using with what options? And what is your goal. Synchronizing 10 large Ubuntu distributions into a single repository is about as resource intensive as it is possible to go and most likely untested.

Sorry, what is mean "What publisher"? I am using one what have in API instruction for example: /pulp/api/v3/docs/#operation/publications_deb_apt_create

My goal make local mirror repository as http://archive.ubuntu.com/ubuntu/
This repository now have all 10 parts in one (before it was different by domain)

[pulpbot]

From: @quba42 (quba42)
Date: 2021-08-12T15:17:11Z

---

If you are specifically trying to mirror, consider using the Verbatim publisher, rather than the APT publisher. It should be more efficient in the publication since it does not need to generate any metadata.

See the high level documentation for both types of publication:

• https://docs.pulpproject.org/pulp_deb/feature_overview.html#simple-and-structured-publishing
• https://docs.pulpproject.org/pulp_deb/feature_overview.html#verbatim-publishing

Or see the relevant API docs:

• https://docs.pulpproject.org/pulp_deb/restapi.html#tag/Publications:-Verbatim

[pulpbot]

From: wilful (wilful)
Date: 2021-08-12T15:44:20Z

---

thanks, i going to try Verbatim publisher (or split repositories by dist), may be it help me create identical mirror as Ubuntu.

[quba42]

The suggestions appear to have helped the user (at least we have not heard back again).
I am closing this "NOT A BUG".