Comments (4)
floehopper
commented on July 18, 2024
We ran a version of the script in integration earlier today requesting 1000 samples. It didn't complete because it got a 502 Gateway Timeout response which raised an exception, but it did give the following output:
id visible whitehall_code asset_manager_code whitehall_location asset_manager_location
509849 false
301471 false
543798 false
264002 true 200 200
434858 false
78669 false
258127 false
8402 true 200 200
506495 true 200 200
586674 false
432366 false
238718 true 200 200
504793 false
220914 true 200 200
534054 false
288222 true 200 200
332051 true 200 200
267900 false
82938 true 200 200
489028 false
368460 false
466746 true 200 200
300517 true 200 200
512477 false
425869 false
656583 false
600805 false
440579 false
464668 false
550365 true 200 200
200455 true 200 200
212071 false
383457 false
321026 true 200 200
328783 true 200 200
403554 false
614638 false
404600 false
480578 true 200 200
666622 true 200 200
218298 true 200 200
371689 false
482666 false
574706 false
276249 false
555955 false
614911 false
449002 true 200 200
314926 false
410522 false
366086 false
599747 true 200 200
430818 false
2380 true 200 200
668342 false
622675 true 200 200
199819 false
236445 false
602241 false
312560 false
378207 true 200 200
543645 false
314639 false
273531 true 200 200
503238 true 200 200
195309 false
425699 false
597825 true 200 200
116637 false
360593 false
508182 true 200 200
626239 false
346714 false
306035 true 200 200
518281 true 200 200
373703 false
624428 false
287133 true 200 200
185405 false
585114 false
428922 false
330193 false
226385 false
521513 false
448573 true 200 200
630572 true 200 200
305975 true 200 200
208654 false
360172 true 200 200
596388 true 200 200
469160 false
343398 false
483776 false
391224 false
407508 false
475555 false
662740 true 200 200
618804 false
568470 false
517066 true 200 200
482387 false
498115 true 200 200
604673 true 200 200
422187 false
223268 false
447203 true 200 200
340502 true 200 200
285758 true 200 200
641021 true 200 200
577637 false
628791 false
402013 true 200 200
495909 false
390208 false
81568 true 200 200
499585 true 200 200
226093 true 200 200
656360 true 200 200
354495 false
508531 false
430725 false
349817 true 200 200
500682 true 200 200
244901 false
273085 false
388804 true 200 200
460416 true 200 200
259201 true 200 200
212999 true 200 200
659175 true 200 200
306817 false
648079 false
328413 false
239515 false
586491 true 200 200
294667 true 200 200
671950 false
670724 true 200 301 https://draft-assets.integration.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/695641/11_sch_V5.pdf
644699 true 200 200
474120 false
457824 true 200 200
236128 false
498566 true 200 200
217385 true 200 200
533870 false
494338 true 200 200
482705 true 200 200
494939 false
644437 true 200 200
215020 true 200 200
402330 true 200 200
236160 false
203336 false
516335 false
229295 false
303570 true 200 200
185669 false
272066 true 200 200
164208 false
51965 false
584081 true 200 200
664528 false
137272 false
285929 true 200 200
411929 false
548945 true 200 200
499980 false
322688 true 200 200
269944 false
12819 false
588634 true 200 200
516320 false
442468 true 200 200
551878 true 200 200
433256 false
384322 false
163975 false
481348 true 200 200
300402 false
27131 true 200 200
253765 true 200 200
628605 true 200 200
669372 false
286224 false
326121 false
636219 false
659979 false
512014 false
172426 false
166188 false
605263 false
606799 true 200 200
297030 false
471227 true 200 200
551002 false
497025 true 200 200
445955 false
276191 false
259498 false
459483 true 200 200
69425 false
299271 false
387088 true 200 200
506385 false
641608 false
321611 false
402080 false
314633 false
499409 false
365833 true 200 200
509700 true 200 200
49626 false
216638 true 200 200
392130 false
547302 true 200 200
594658 false
621589 false
303076 true 200 200
670427 true 200 200
303912 true 200 200
8988 true 200 200
48217 true 200 200
486238 false
324454 false
541713 false
214096 true 200 200
231387 true 200 200
12278 false
430038 false
258472 false
34588 true 200 200
548773 true 200 200
660414 false
597689 false
367651 true 200 200
344216 false
480448 false
494065 true 200 200
494296 false
266428 true 200 200
657285 false
508193 true 200 200
428446 false
645282 false
372972 true 200 200
278368 false
417339 true 200 200
574455 true 200 200
452071 false
370029 false
300069 true 200 200
126792 false
487193 false
548805 true 200 200
390325 false
555048 true 200 200
419759 false
519511 false
509109 false
61186 false
221359 false
48326 false
235666 false
314204 false
278665 false
479475 true 200 200
435319 false
82829 false
489105 true 200 404
323268 false
438880 false
470661 false
281942 false
14234 false
520643 false
244195 false
49998 false
100633 false
292289 true 200 200
331168 false
117712 true 200 200
211409 false
262678 false
590916 false
509314 false
620689 false
256962 false
449615 false
390297 true 200 200
306443 true 200 200
673818 false
520371 true 200 200
365235 false
402029 true 200 200
221245 false
421026 true 200 200
197633 true 200 200
368536 false
417535 true 200 200
636339 false
667751 true 200 200
2623 true 200 200
479181 false
31649 true 200 200
532060 false
470945 false
567968 false
509762 true 200 200
313123 true 200 200
601810 true 200 200
186672 false
668376 true 200 200
3518 false
561077 true 200 200
592289 true 200 200
191318 false
465009 false
239862 false
580819 false
286046 false
66616 true 200 200
609329 false
317766 true 200 200
562618 true 200 200
428072 false
61870 true 200 200
350928 true 200 200
516228 false
624863 true 200 200
654544 true 200 200
412124 false
299703 false
263722 false
608465 true 200 200
402885 false
567190 true 200 200
611274 true 200 200
246504 false
445893 false
351137 false
253509 false
541329 true 200 200
573857 true 200 200
448950 false
673223 false
467586 false
169942 false
344498 false
244626 false
27835 false
638660 false
98410 true 200 200
214556 true 200 200
528918 true 200 200
330050 false
463908 false
539362 true 200 200
455844 false
445031 false
213705 true 200 200
664292 true 200 200
310597 true 200 200
321554 false
525275 false
617605 false
343887 true 200 200
370643 true 200 200
501130 false
655473 true 200 200
493242 true 200 200
39374 false
84081 true 200 200
643209 true 200 200
438642 false
282752 false
264365 true 200 200
480699 true 200 200
365808 false
473115 false
571894 true 200 200
270528 true 200 200
666237 false
493955 false
649532 true 200 301 https://draft-assets.integration.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/686735/Prompt_Payments_Performance_2017-18ods.ods
621195 true 200 200
401566 false
637432 true 200 200
642510 true 200 200
653819 false
546840 false
639490 true 200 200
588472 true 200 200
443511 true 200 200
501483 true 200 200
439666 true 200 200
279308 true 200 200
311177 false
580240 false
448579 true 200 200
380500 true 200 200
669466 false
445198 false
332959 true 200 200
337479 false
206256 false
589297 false
525976 true 200 200
583766 false
187554 false
27771 true 200 200
445272 false
345866 false
311817 false
336122 false
190690 true 200 200
355621 false
488691 false
190015 false
13093 false
264586 false
387647 false
573400 true 200 200
438436 false
611158 false
310339 false
382292 true 200 200
189584 false
186977 true 200 200
192220 true 200 200
281098 true 200 200
223235 true 200 200
421495 true 200 200
317509 false
574023 false
631740 false
370127 true 200 200
472763 false
362218 true 200 200
641661 false
646172 true 200 200
337235 false
585756 true 200 200
355469 false
353516 false
330367 false
657230 true 200 200
545546 false
117594 false
414495 false
315153 true 200 200
357559 true 200 200
219895 true 200 200
7225 true 200 200
172629 false
417748 false
467889 false
43342 true 200 200
546707 true 200 200
651597 true 200 200
505731 true 200 200
9902 false
625888 true 200 200
635578 false
395424 false
7672 true 200 200
238909 false
293745 false
551050 true 200 200
442062 false
436863 true 200 200
477994 false
629212 true 200 200
419567 true 200 200
575673 false
360475 true 200 200
345283 false
198625 false
13005 false
563114 false
473900 true 200 200
467725 false
524963 false
602233 true 200 200
482801 true 200 200
416765 false
466264 false
293244 true 200 200
507998 true 200 200
502778 false
417035 true 200 200
305660 false
441528 true 200 200
115974 true 200 200
655925 false
206596 true 200 200
458866 false
290940 true 200 200
581761 false
167405 false
10366 false
398646 true 200 200
198032 true 200 200
440232 true 200 200
586564 false
14574 false
580790 false
176183 false
368157 true 200 200
453196 true 200 200
467090 false
156314 false
362626 true 200 200
249315 true 200 200
375830 true 200 200
256135 false
622625 true 200 200
663330 true 200 200
243556 false
253994 false
619941 false
440384 true 200 200
423258 false
199077 false
157814 false
431262 false
31439 false
661127 true 200 200
219412 true 200 200
360842 false
297374 false
350566 false
478392 false
447326 true 200 200
345531 false
503721 false
560296 true 200 200
565642 true 200 200
215981 true 200 200
313975 false
316968 false
640186 true 200 200
486182 false
167085 false
318408 true 200 200
501181 true 200 200
220394 true 200 200
538570 true 200 200
281304 false
517767 true 200 200
633039 true 200 200
372486 false
589946 true 200 200
581237 false
431145 true 200 200
215139 true 200 200
437559 true 200 200
167589 false
548399 true 200 200
649118 true 200 200
278850 false
226534 true 200 200
659898 false
373554 true 200 200
550439 true 200 200
540270 false
582774 true 200 200
258164 false
486637 false
623866 false
489677 false
146705 false
433020 true 200 200
260853 true 200 200
329113 false
621098 true 200 200
294428 false
480731 false
498083 true 200 200
509396 false
506267 true 200 200
612289 false
314353 false
98114 false
602917 false
549065 false
382186 false
246939 false
338052 false
200755 true 200 200
303768 false
390136 false
567664 false
282898 false
72841 true 200 200
279458 true 200 200
445926 false
325591 false
651430 false
488709 true 200 404
329767 true 200 200
604715 false
359310 false
477982 false
645988 false
230196 true 200 200
39705 true 200 200
647679 true 200 200
216710 true 200 200
200091 true 200 200
594092 false
541240 false
626794 false
573335 false
502891 true 200 200
62391 true 200 200
658476 true 200 200
367971 false
427379 true 200 200
413126 false
536579 true 200 200
280843 false
371595 false
12746 false
590375 false
578245 false
493094 false
666882 true 200 404
240329 false
33382 true 200 200
575057 false
89876 true 200 200
445918 false
554080 true 200 200
209033 false
222906 true 200 200
345273 false
604115 true 200 200
655094 false
193140 false
152398 false
599506 false
391876 false
212668 false
327837 true 200 200
564281 false
659679 true 200 200
632651 true 200 200
390932 false
225302 true 200 200
598623 false
673453 false
36092 false
534346 false
315142 false
304672 true 200 200
89896 false
203493 true 200 200
605459 true 200 200
522844 false
611193 true 200 200
369994 true 200 200
541820 false
35980 true 200 200
589092 false
16117 true 200 200
182596 false
207214 true 200 200
412823 false
349809 true 200 200
615894 false
250879 true 200 200
626508 true 404 404
632903 false
275574 false
561436 true 200 200
207289 true 200 200
311346 true 200 200
422953 false
449156 false
578559 true 200 200
169961 false
257485 false
383721 false
414001 true 200 200
6061 true 200 200
498876 false
444241 true 200 200
85334 true 200 200
348330 false
13767 false
516278 false
416261 false
436354 true 200 200
389522 true 200 200
439464 true 200 200
175007 false
621157 true 200 200
317229 false
322731 true 200 200
512352 false
359519 false
548645 true 200 200
483515 true 200 200
643920 true 200 200
415081 true 200 200
245673 true 200 200
612907 false
5948 true 200 200
275991 false
322088 false
184224 false
474234 false
361733 false
448587 false
627992 false
600506 false
184066 true 200 200
13614 false
366498 true 200 301 https://draft-assets.integration.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/676574/VAT_GovTalkHeader_v3.1.pdf
476079 true 200 200
217534 true 200 200
429801 true 200 200
217741 true 200 200
380368 false
276633 false
633557 false
474373 true 200 200
371136 false
463147 false
349489 false
540878 true 200 200
491219 false
303962 false
345596 false
525069 false
518233 false
536652 false
588897 true 200 200
317216 false
282595 false
321043 true 200 200
564612 true 200 200
590309 false
198747 false
169968 false
49653 true 200 200
136214 false
238914 false
298373 false
291173 true 200 200
127073 false
351986 true 200 200
249604 false
461461 true 200 200
645458 false
355873 true 200 200
115865 true 200 200
416688 true 200 200
223296 false
172567 false
327486 false
563949 true 200 200
12397 false
309544 false
554647 false
7974 false
300840 false
572019 false
484229 false
526820 false
268693 true 200 200
628829 true 200 200
600735 true 200 200
200360 true 200 200
653302 false
440294 false
616154 true 200 200
464457 true 200 200
208547 true 200 200
613288 true 404 404
248391 false
582796 false
476333 true 200 200
390498 false
469173 true 200 200
142867 true 200 200
99088 true 200 200
603478 true 200 200
575184 true 200 200
47767 true 200 200
263149 true 200 200
431451 false
603998 true 200 200
600500 true 200 200
239104 true 200 200
559342 false
182561 false
639055 true 200 200
420884 false
622978 true 200 200
611821 true 200 200
390401 false
361992 true 200 200
126978 false
250612 true 200 200
277888 true 200 200
503189 false
262361 true 200 200
478168 false
595785 false
381799 true 200 200
85819 true 200 200
443316 false
341787 true 200 200
575679 false
467069 false
467771 false
510446 true 200 200
251493 true 200 301 https://draft-assets.integration.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/310014/DH_Consultation_on_NHS_Trust.pdf
491609 false
308834 false
628970 true 200 200
398726 true 200 200
262107 true 200 200
442552 false
666041 true 200 200
388363 false
360963 true 200 200
458038 true 200 200
324383 true 200 200
630942 true 200 200
498577 false
585898 true 200 200
602031 false
550692 true 200 200
339420 false
491740 false
333128 true 200 301 https://draft-assets.integration.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/691785/v112-declaration-of-exemption-from-mot.pdf
450329 true 200 200
628388 true 200 200
589395 true 200 200
412013 true 200 200
274779 true 200 200
190642 true 200 200
268343 true 200 200
669421 true 200 200
333021 true 200 200
522592 false
69694 false
502710 false
447568 true 200 200
236581 false
450028 true 200 200
632887 true 200 200
47973 false
365723 true 200 200
418929 true 200 200
603705 true 200 301 https://draft-assets.integration.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/677878/AS1w__2017-04-01_.pdf
510794 true 200 200
415546 false
360937 false
255038 true 200 200
340182 true 200 200
243423 true 200 200
539428 false
369910 false
516862 true 200 200
288413 false
346969 false
619250 false
577395 false
346969 false
619250 false
577395 false
from asset-manager.
floehopper
commented on July 18, 2024
I've described my investigation into the AttachmentData with ID 251493 in #543.
from asset-manager.
floehopper
commented on July 18, 2024
I've also investigated three of the apparent discrepancies where Whitehall responds with a 200 OK and Asset Manager with a 301 Moved Permanently. Our initial hypothesis was that the data in the Whitehall did not appear to be up-to-date (i.e. from the environment sync) and this seems to be borne out by requesting three of the same attachments in production where we see 301 Moved Permanently for both Whitehall and Asset Manager requests:
https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/670724/11_sch_V1_01.01.2018.pdf
301 Moved Permanently
Location: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/695641/11_sch_V5.pdf
https://draft-assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/670724/11_sch_V1_01.01.2018.pdf
301 Moved Permanently
Location: https://draft-assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/695641/11_sch_V5.pdf
https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/649532/Prompt_Payments_Performance_2017-18.ods
301 Moved Permanently
Location: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/686735/Prompt_Payments_Performance_2017-18ods.ods
https://draft-assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/649532/Prompt_Payments_Performance_2017-18.ods
301 Moved Permanently
Location: https://draft-assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/686735/Prompt_Payments_Performance_2017-18ods.ods
https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/366498/vat-online-govtalk-bus-rules-v3.0.pdf
301 Moved Permanently
Location: https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/676574/VAT_GovTalkHeader_v3.1.pdf
https://draft-assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/366498/vat-online-govtalk-bus-rules-v3.0.pdf
301 Moved Permanently
Location: https://draft-assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/676574/VAT_GovTalkHeader_v3.1.pdf
from asset-manager.
thomasleese
commented on July 18, 2024
This has been done now.
from asset-manager.
Related Issues (20)
- Rationalise Mainstream asset filename redirect & Whitehall asset replacement redirect
- Marking Whitehall attachments as deleted should delete corresponding Asset Manager assets when appropriate HOT 7
- Improve the access-limiting implementation
- Update parent_document_url of Whitehall attachments in Asset Manager HOT 2
- Fix setting of draft status for Whitehall attachment assets in Asset Manager HOT 2
- Update redirect_url for replaced assets HOT 2
- Update redirect_url for unpublished/withdrawn assets HOT 2
- Standardise Whitehall and Mainstream Cache-Control headers HOT 7
- NoMethodError in AssetManagerCreateWhitehallAssetWorker HOT 12
- Investigate whether deleted editions break the logic in AttachmentData#significant_attachment HOT 2
- Update metadata of Whitehall attachments in Asset Manager HOT 19
- Investigate possible bug in AttachmentData#last_attachment HOT 2
- Remove attachments from NFS
- Stop CsvPreviewController depending on attachment file existing on the filesystem HOT 2
- It should be possible to update an asset if its replacement has been deleted HOT 1
- Consider adding tests to publishing-e2e-tests repo
- Dependabot can't resolve your Ruby dependency files HOT 1
- Investigate replaced Whitehall attachment on discarded edition HOT 5
- Ensure all AssetManager-related Sidekiq jobs in Whitehall are idempotent
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from asset-manager.