Giter Site home page Giter Site logo

抓取了一个相册非常多的QQ,但是打开相册报错,相册数量较多导致?(之前抓取过另外一个QQ号,相册东西少,没有报错。) about qzoneexporter HOT 11 CLOSED

wwwpf avatar wwwpf commented on May 29, 2024
抓取了一个相册非常多的QQ,但是打开相册报错,相册数量较多导致?(之前抓取过另外一个QQ号,相册东西少,没有报错。)

from qzoneexporter.

Comments (11)

wwwpf avatar wwwpf commented on May 29, 2024

对应的 json 数据里有 id 吗?

from qzoneexporter.

softshield avatar softshield commented on May 29, 2024

对应的 json 数据里有 id 吗?

album_info.json 这个文件里面id都是有的

from qzoneexporter.

softshield avatar softshield commented on May 29, 2024

看了下源码,然后对比了json数据结构:

{
"code": 0,
"subcode": 0,
"message": "",
"default": 0,
"data": {
"albumListModeClass": [
{
"albumList": [
{

似乎和正常的JSON不一样,正常的如下:
{
"code": 0,
"subcode": 0,
"message": "",
"default": 0,
"data": {
"albumListModeSort": [

【albumListModeClass】 和 【albumListModeSort】的区别?

相册分类导致?

from qzoneexporter.

wwwpf avatar wwwpf commented on May 29, 2024

代码会尝试使用 albumListModeClass 和 albumListModeClass 两个 key 来找数据,把报错的这个json数据删除无关信息后发出来看看?
手滑写错了 key,忘记 generator.py 并没有处理 albumListModeClass 了。

from qzoneexporter.

softshield avatar softshield commented on May 29, 2024

代码会尝试使用 albumListModeClass 和 albumListModeClass 两个 key 来找数据,把报错的这个json数据删除无关信息后发出来看看?

{
"code": 0,
"subcode": 0,
"message": "",
"default": 0,
"data": {
"albumListModeClass": [
{
"albumList": [
{
"allowAccess": 1,
"anonymity": 2,
"bitmap": "10000001",
"classid": 101,
"comment": 172,
"createtime": 1262241723,
"desc": " ",
"handset": 0,
"id": "xxx",
"lastuploadtime": 1550384274,
"modifytime": 1550383714,
"name": "xxx",
"order": 1,
"pre": "https://b10.photo.store.qq.com/psb?/xxx",
"priv": 4,
"pypriv": 4,
"total": 525,
"viewtype": 2
}
],
"classId": 101,
"nextPageStart": 10,
"totalInClass": 10,
"totalInPage": 10
},
{
"albumList": [
{
"allowAccess": 1,
"anonymity": 6,
"bitmap": "10000001",
"classid": 104,
"comment": 3,
"createtime": 1423483520,
"desc": " ",
"handset": 0,
"id": "xxx",
"lastuploadtime": 1428591083,
"modifytime": 1469766202,
"name": "xxx",
"order": 0,
"priv": 4,
"pypriv": 4,
"total": 114,
"viewtype": 6
}
],
"classId": 104,
"nextPageStart": 5,
"totalInClass": 5,
"totalInPage": 5
},
{
"albumList": [

      {
        "allowAccess": 1,
        "anonymity": 2,
        "bitmap": "10000001",
        "classid": 106,
        "comment": 3,
        "createtime": 1270883484,
        "desc": " ",
        "handset": 0,
        "id": "xxx",
        "lastuploadtime": 1428590647,
        "modifytime": 1428590686,
        "name": "╮xxx",
        "order": 16,
        "priv": 4,
        "pypriv": 3,
        "total": 167,
        "viewtype": 2
      }
    ],
    "classId": 106,
    "nextPageStart": 14,
    "totalInClass": 14,
    "totalInPage": 14
  },
  {
    "albumList": [
      {
        "allowAccess": 1,
        "anonymity": 0,
        "bitmap": "10000000",
        "classid": 107,
        "comment": 0,
        "createtime": 1473161555,
        "desc": "",
        "handset": 1,
        "id": "xxx",
        "lastuploadtime": 1479391921,
        "modifytime": 1479391957,
        "name": "xxx",
        "order": 4294967295,
        "priv": 1,
        "pypriv": 3,
        "total": 0,
        "viewtype": 0
      }
    ],
    "classId": 107,
    "nextPageStart": 0,
    "totalInClass": 1,
    "totalInPage": 1
  }
],
"albumsInUser": 30,
"classList": [
  {
    "id": 101,
    "name": "人物"
  },
  {
    "id": 100,
    "name": "最爱"
  },
  {
    "id": 102,
    "name": "风景"
  },
  {
    "id": 103,
    "name": "动物"
  },
  {
    "id": 104,
    "name": "游记"
  },
  {
    "id": 105,
    "name": "卡通"
  },
  {
    "id": 106,
    "name": "生活"
  },
  {
    "id": 107,
    "name": "其他"
  }
],
"limit": 0,
"mode": 3,
"sortOrder": 2,
"t": "",
"user": {
  "diskused": "321.19",
  "microalbum": 0,
  "mspec": 1,
  "ordermode": 1,
  "ordertype": 2,
  "ownerface": 1,
  "preurlspec": "i",
  "time": 1569306326,
  "userbit": 0
}

}
}

from qzoneexporter.

wwwpf avatar wwwpf commented on May 29, 2024

这些 json 数据又嵌套了一层,需要再通过 albumList 访问,这种数据多吗,这些相册是什么时候创建的?

from qzoneexporter.

softshield avatar softshield commented on May 29, 2024

这些 json 数据又嵌套了一层,需要再通过 albumList 访问,这种数据多吗,这些相册是什么时候创建的?

15年、17年、19年都有

from qzoneexporter.

Yang-z avatar Yang-z commented on May 29, 2024

这些 json 数据又嵌套了一层,需要再通过 albumList 访问,这种数据多吗,这些相册是什么时候创建的?

看来这种情况photo_exif_recover.py中也要考虑到。

from qzoneexporter.

wwwpf avatar wwwpf commented on May 29, 2024

网页显示时忘记考虑相册在排序视图下的 json 格式

from qzoneexporter.

wwwpf avatar wwwpf commented on May 29, 2024

这些 json 数据又嵌套了一层,需要再通过 albumList 访问,这种数据多吗,这些相册是什么时候创建的?

看来这种情况photo_exif_recover.py中也要考虑到。

统一一下,调用 tools.pyget_album_list_data 获取数据。

from qzoneexporter.

Yang-z avatar Yang-z commented on May 29, 2024

这些 json 数据又嵌套了一层,需要再通过 albumList 访问,这种数据多吗,这些相册是什么时候创建的?

看来这种情况photo_exif_recover.py中也要考虑到。

统一一下,调用 tools.pyget_album_list_data 获取数据。

好的,我回头测试一下。

from qzoneexporter.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.