Giter Site home page Giter Site logo

litex-hub / pythondata-auto Goto Github PK

View Code? Open in Web Editor NEW
4.0 4.0 10.0 95 KB

Scripts which automate the creation of the `litex.data` Python modules from various git repositories.

License: Apache License 2.0

Python 85.19% Makefile 5.18% Jinja 9.63%

pythondata-auto's Introduction

litex-data-auto

A couple of simple scripts for automatically managing the litex-data-XXXX Python modules which contain data from various git repositories.

pythondata-auto's People

Contributors

e-matthews avatar enjoy-digital avatar jmerdich avatar kgugala avatar mithro avatar nuntipat avatar pcotret avatar scanakci avatar stffrdhrn avatar

Stargazers

 avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar

pythondata-auto's Issues

CI is currently failing?

https://github.com/litex-hub/pythondata-auto/runs/3808023659?check_suite_focus=true

Cloning into bare repository 'srcs/pythondata-software-picolibc'...

picolibc Config
picolibc
  picolibc 0.0.post21344 (0, 0, 21344)
  Tools: 0.0.post105 (0, 0, 105)
   Data: 0.0.post21239 (0, 0, 21239)
  Updating repo  litex-hub/pythondata-software-picolibc
  404 {"message": "Not Found", "documentation_url": "https://docs.github.com/rest/reference/repos#update-a-repository"}
  Cloning into 'repos/pythondata-software-picolibc'...
  Submodule 'pythondata_software_picolibc/data' (https://github.com/picolibc/picolibc) registered for path 'pythondata_software_picolibc/data'
  Cloning into '/home/runner/work/pythondata-auto/pythondata-auto/repos/pythondata-software-picolibc/pythondata_software_picolibc/data'...
  Submodule path 'pythondata_software_picolibc/data': checked out '53567cf82b92f1bd777ed57111232a110666b4df'
  
  Updating: pythondata-software-picolibc
  ---------------------------------------------------------------------------
    Updating repos/pythondata-software-picolibc                           from /home/runner/work/pythondata-auto/pythondata-auto/templates
    Creating repos/pythondata-software-picolibc/pythondata_software_picolibc from /home/runner/work/pythondata-auto/pythondata-auto/templates/__py__
    Creating repos/pythondata-software-picolibc/.github                   from /home/runner/work/pythondata-auto/pythondata-auto/templates/.github
     Copying repos/pythondata-software-picolibc/Makefile                  from /home/runner/work/pythondata-auto/pythondata-auto/templates/Makefile
   Rendering repos/pythondata-software-picolibc/MANIFEST.in               from /home/runner/work/pythondata-auto/pythondata-auto/templates/MANIFEST.in.jinja
   Rendering repos/pythondata-software-picolibc/README.md                 from /home/runner/work/pythondata-auto/pythondata-auto/templates/README.md.jinja
     Copying repos/pythondata-software-picolibc/requirements.txt          from /home/runner/work/pythondata-auto/pythondata-auto/templates/requirements.txt
   Rendering repos/pythondata-software-picolibc/setup.py                  from /home/runner/work/pythondata-auto/pythondata-auto/templates/setup.py.jinja
   Rendering repos/pythondata-software-picolibc/test.py                   from /home/runner/work/pythondata-auto/pythondata-auto/templates/test.py.jinja
     Copying repos/pythondata-software-picolibc/.gitattributes            from /home/runner/work/pythondata-auto/pythondata-auto/templates/.gitattributes
     Copying repos/pythondata-software-picolibc/.gitignore                from /home/runner/work/pythondata-auto/pythondata-auto/templates/.gitignore
    Updating repos/pythondata-software-picolibc/pythondata_software_picolibc from /home/runner/work/pythondata-auto/pythondata-auto/templates/__py__
   Rendering repos/pythondata-software-picolibc/pythondata_software_picolibc/__init__.py from /home/runner/work/pythondata-auto/pythondata-auto/templates/__py__/__init__.py.jinja
    Updating repos/pythondata-software-picolibc/.github                   from /home/runner/work/pythondata-auto/pythondata-auto/templates/.github
    Creating repos/pythondata-software-picolibc/.github/workflows         from /home/runner/work/pythondata-auto/pythondata-auto/templates/.github/workflows
    Updating repos/pythondata-software-picolibc/.github/workflows         from /home/runner/work/pythondata-auto/pythondata-auto/templates/.github/workflows
     Copying repos/pythondata-software-picolibc/.github/workflows/publish-to-pypi.yml from /home/runner/work/pythondata-auto/pythondata-auto/templates/.github/workflows/publish-to-pypi.yml
  ---------------------------------------------------------------------------
  git submodule update --remote --merge
  On branch master
  Your branch is up to date with 'origin/master'.
  
  nothing to commit, working tree clean
  Traceback (most recent call last):
    File "./update.py", line 587, in <module>
      sys.exit(main(sys.argv[0], sys.argv[1:]))
    File "./update.py", line 566, in main
      update(m)
    File "./update.py", line 405, in update
      subprocess_check_call(['git', 'commit', '-F', f.name], cwd=repo_dir)
    File "./update.py", line 27, in subprocess_check_call
      return subprocess.check_call(*args, **kw)
    File "/usr/lib/python3.6/subprocess.py", line 311, in check_call
      raise CalledProcessError(retcode, cmd)
  subprocess.CalledProcessError: Command '['git', 'commit', '-F', '/tmp/tmpus_azzns']' returned non-zero exit status 1.
  Error: Process completed with exit code 1.

CI failing on picolibc

picolibc Config
picolibc
  picolibc 0.0.post21348 (0, 0, 21348)
  Tools: 0.0.post108 (0, 0, 108)
   Data: 0.0.post21240 (0, 0, 21240)
  Updating repo  litex-hub/pythondata-software-picolibc
  404 {"message": "Not Found", "documentation_url": "https://docs.github.com/rest/reference/repos#update-a-repository"}
  Cloning into 'repos/pythondata-software-picolibc'...
  Submodule 'pythondata_software_picolibc/data' (https://github.com/picolibc/picolibc) registered for path 'pythondata_software_picolibc/data'
  Cloning into '/home/runner/work/pythondata-auto/pythondata-auto/repos/pythondata-software-picolibc/pythondata_software_picolibc/data'...
  Submodule path 'pythondata_software_picolibc/data': checked out '53567cf82b92f1bd777ed57111232a110666b4df'
  
  Updating: pythondata-software-picolibc
  ---------------------------------------------------------------------------
    Updating repos/pythondata-software-picolibc                           from /home/runner/work/pythondata-auto/pythondata-auto/templates
    Creating repos/pythondata-software-picolibc/pythondata_software_picolibc from /home/runner/work/pythondata-auto/pythondata-auto/templates/__py__
    Creating repos/pythondata-software-picolibc/.github                   from /home/runner/work/pythondata-auto/pythondata-auto/templates/.github
     Copying repos/pythondata-software-picolibc/Makefile                  from /home/runner/work/pythondata-auto/pythondata-auto/templates/Makefile
   Rendering repos/pythondata-software-picolibc/MANIFEST.in               from /home/runner/work/pythondata-auto/pythondata-auto/templates/MANIFEST.in.jinja
   Rendering repos/pythondata-software-picolibc/README.md                 from /home/runner/work/pythondata-auto/pythondata-auto/templates/README.md.jinja
     Copying repos/pythondata-software-picolibc/requirements.txt          from /home/runner/work/pythondata-auto/pythondata-auto/templates/requirements.txt
   Rendering repos/pythondata-software-picolibc/setup.py                  from /home/runner/work/pythondata-auto/pythondata-auto/templates/setup.py.jinja
   Rendering repos/pythondata-software-picolibc/test.py                   from /home/runner/work/pythondata-auto/pythondata-auto/templates/test.py.jinja
     Copying repos/pythondata-software-picolibc/.gitattributes            from /home/runner/work/pythondata-auto/pythondata-auto/templates/.gitattributes
     Copying repos/pythondata-software-picolibc/.gitignore                from /home/runner/work/pythondata-auto/pythondata-auto/templates/.gitignore
    Updating repos/pythondata-software-picolibc/pythondata_software_picolibc from /home/runner/work/pythondata-auto/pythondata-auto/templates/__py__
   Rendering repos/pythondata-software-picolibc/pythondata_software_picolibc/__init__.py from /home/runner/work/pythondata-auto/pythondata-auto/templates/__py__/__init__.py.jinja
    Updating repos/pythondata-software-picolibc/.github                   from /home/runner/work/pythondata-auto/pythondata-auto/templates/.github
    Creating repos/pythondata-software-picolibc/.github/workflows         from /home/runner/work/pythondata-auto/pythondata-auto/templates/.github/workflows
    Updating repos/pythondata-software-picolibc/.github/workflows         from /home/runner/work/pythondata-auto/pythondata-auto/templates/.github/workflows
     Copying repos/pythondata-software-picolibc/.github/workflows/publish-to-pypi.yml from /home/runner/work/pythondata-auto/pythondata-auto/templates/.github/workflows/publish-to-pypi.yml
  ---------------------------------------------------------------------------
  [master 5285816] Updating pythondata-software-picolibc to 0.0.post21348
   1 file changed, 20 insertions(+), 15 deletions(-)
  git submodule update --remote --merge
  Updating 53567cf82..4b4a69f42
  Fast-forward
   meson.build | 1 -
   1 file changed, 1 deletion(-)
  Submodule path 'pythondata_software_picolibc/data': merged in '4b4a69f42f2e6fa5d6e44607adefe10f38d1b51a'
  Traceback (most recent call last):
    File "./update.py", line 588, in <module>
      sys.exit(main(sys.argv[0], sys.argv[1:]))
    File "./update.py", line 567, in main
      update(m)
    File "./update.py", line 405, in update
      f.flush()
    File "/usr/lib/python3.6/tempfile.py", line 624, in func_wrapper
      return func(*args, **kwargs)
  ValueError: flush of closed file
  Error: Process completed with exit code 1.

CI failure due to syntax error?

ibex Config
ibex

Cloning into bare repository 'srcs/pythondata-misc-opentitan'...
Traceback (most recent call last):
  File "./update.py", line 588, in <module>
    sys.exit(main(sys.argv[0], sys.argv[1:]))
  File "./update.py", line 540, in main
    get_src(m)
  File "./update.py", line 210, in get_src
    module_data['git_msg'] = git_msg
  File "/usr/lib/python3.6/configparser.py", line 1238, in __setitem__
    return self._parser.set(self._name, key, value)
  File "/usr/lib/python3.6/configparser.py", line 1193, in set
    super().set(section, option, value)
  File "/usr/lib/python3.6/configparser.py", line 894, in set
    value)
  File "/usr/lib/python3.6/configparser.py", line 402, in before_set
    "position %d" % (value, tmp_value.find('%')))
ValueError: invalid interpolation syntax in 'commit 29e1062c6537918c323d4e11fa30201898611e33\nAuthor: Philipp Wagner <[email protected]>\nDate:   Thu Oct 7 20:36:59 2021 +0100\n\n    Revert "[otbn,dv] Sort out timing for done/status signals in ISS"\n    \n    This reverts commit aee499c3e167096c6baecf8f9e989d75e94125ff.\n    \n    This commit breaks private CI:\n    \n    ```\n    2021-10-07T15:41:49.9790201Z ### Test Results\n    2021-10-07T15:41:49.9790752Z |  Milestone  |          Name           | Tests             |  Passing  |  Total  |  Pass Rate  |\n    2021-10-07T15:41:49.9792463Z |:-----------:|:-----------------------:|:------------------|:---------:|:-------:|:-----------:|\n    2021-10-07T15:41:49.9793370Z |     V1      |          smoke          | otbn_smoke        |     0     |    1    |   0.00 %    |\n    2021-10-07T15:41:49.9794048Z |     V1      |      csr_hw_reset       | otbn_csr_hw_reset |     1     |    1    |  100.00 %   |\n    2021-10-07T15:41:49.9794785Z |     V1      |         csr_rw          | otbn_csr_rw       |     1     |    1    |  100.00 %   |\n    2021-10-07T15:41:49.9795479Z |     V1      |                         | **TOTAL**         |     2     |    3    |   66.67 %   |\n    2021-10-07T15:41:49.9796165Z |     V2      | tl_d_outstanding_access | otbn_csr_hw_reset |     1     |    1    |  100.00 %   |\n    2021-10-07T15:41:49.9796889Z |             |                         | otbn_csr_rw       |     1     |    1    |  100.00 %   |\n    2021-10-07T15:41:49.9797568Z |     V2      |   tl_d_partial_access   | otbn_csr_hw_reset |     1     |    1    |  100.00 %   |\n    2021-10-07T15:41:49.9798330Z |             |                         | otbn_csr_rw       |     1     |    1    |  100.00 %   |\n    2021-10-07T15:41:49.9799006Z |             |                         | **TOTAL**         |     2     |    3    |   66.67 %   |\n    2021-10-07T15:41:49.9799366Z\n    2021-10-07T15:41:49.9799751Z ## Failure Buckets\n    2021-10-07T15:41:49.9799998Z\n    2021-10-07T15:41:49.9800721Z * `UVM_ERROR (otbn_scoreboard.sv:240) [scoreboard] Check failed item.d_data == exp_read_data.val (* [*] vs * [*]) value for register otbn_reg_block.status` has 1 failures:\n    2021-10-07T15:41:49.9801604Z     * Test otbn_smoke has 1 failures.\n    2021-10-07T15:41:49.9802534Z         * 0.otbn_smoke.1\\\n    2021-10-07T15:41:49.9803525Z           Line 42, in log /azp/agent/_work/1/s/scratch/HEAD/otbn-sim-vcs/0.otbn_smoke/out/run.log\n    2021-10-07T15:41:49.9804259Z\n    2021-10-07T15:41:49.9805026Z                 UVM_ERROR @ 184377673 ps: (otbn_scoreboard.sv:240) [uvm_test_top.env.scoreboard] Check failed item.d_data == exp_read_data.val (0 [0x0] vs 1 [0x1]) value for register otbn_reg_block.status\n    2021-10-07T15:41:49.9806203Z                 UVM_INFO @ 184377673 ps: (uvm_report_server.svh:901) [UVM/REPORT/SERVER]\n    2021-10-07T15:41:49.9807126Z                 --- UVM Report Summary ---\n    2021-10-07T15:41:49.9807650Z\n    2021-10-07T15:41:49.9808110Z                 Quit count reached!\n    ```\n    \n    Signed-off-by: Philipp Wagner <[email protected]>\n' at position 758

Changes requested by Florent

As these modules are not actually LiteX specific, we should rename packages to pythondata-<type>-<name>. IE pythondata-cpu-lm32. Then the module can be provided as cpu_lm32.

This also removes a lot of the empty directories and removes the need to worry about namespace packages.

We should still provide a get_data(<type>, <name>) style function (but that might be part of LiteX).

Minerva PyPi upload fails for Python 2 due to non-ASCII character in generated __init__.py

https://github.com/litex-hub/pythondata-cpu-minerva/runs/3807598286?check_suite_focus=true

Traceback (most recent call last):
  File "setup.py", line 6, in <module>
    from pythondata_cpu_minerva import version_str
  File "/home/runner/work/pythondata-cpu-minerva/pythondata-cpu-minerva/pythondata_cpu_minerva/__init__.py", line 27
SyntaxError: Non-ASCII character '\xc3' in file /home/runner/work/pythondata-cpu-minerva/pythondata-cpu-minerva/pythondata_cpu_minerva/__init__.py on line 28, but no encoding declared; see http://python.org/dev/peps/pep-0263/ for details
Error: Process completed with exit code 1.

CI issue due to GitHub API timeout?

https://github.com/litex-hub/pythondata-auto/runs/3839361003?check_suite_focus=true

vexriscv Config
vexriscv
  vexriscv 1.0.1.post377 (1, 0, 1, 377)
  Tools: 0.0.post112 (0, 0, 112)
   Data: 1.0.1.post265 (1, 0, 1)
  Traceback (most recent call last):
    File "/home/runner/.local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 445, in _make_request
      six.raise_from(e, None)
    File "<string>", line 3, in raise_from
    File "/home/runner/.local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 440, in _make_request
      httplib_response = conn.getresponse()
    File "/usr/lib/python3.6/http/client.py", line 1373, in getresponse
      response.begin()
    File "/usr/lib/python3.6/http/client.py", line 311, in begin
      version, status, reason = self._read_status()
    File "/usr/lib/python3.6/http/client.py", line 272, in _read_status
      line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
    File "/usr/lib/python3.6/socket.py", line 586, in readinto
      return self._sock.recv_into(b)
    File "/usr/lib/python3.6/ssl.py", line 1012, in recv_into
      return self.read(nbytes, buffer)
    File "/usr/lib/python3.6/ssl.py", line 874, in read
      return self._sslobj.read(len, buffer)
    File "/usr/lib/python3.6/ssl.py", line 631, in read
      v = self._sslobj.read(len, buffer)
  socket.timeout: The read operation timed out
  
  During handling of the above exception, another exception occurred:
  
  Traceback (most recent call last):
    File "/home/runner/.local/lib/python3.6/site-packages/requests/adapters.py", line 449, in send
      timeout=timeout
    File "/home/runner/.local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 756, in urlopen
      method, url, error=e, _pool=self, _stacktrace=sys.exc_info()[2]
    File "/home/runner/.local/lib/python3.6/site-packages/urllib3/util/retry.py", line 532, in increment
      raise six.reraise(type(error), error, _stacktrace)
    File "/home/runner/.local/lib/python3.6/site-packages/urllib3/packages/six.py", line 770, in reraise
      raise value
    File "/home/runner/.local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 706, in urlopen
      chunked=chunked,
    File "/home/runner/.local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 447, in _make_request
      self._raise_timeout(err=e, url=url, timeout_value=read_timeout)
    File "/home/runner/.local/lib/python3.6/site-packages/urllib3/connectionpool.py", line 337, in _raise_timeout
      self, url, "Read timed out. (read timeout=%s)" % timeout_value
  urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='api.github.com', port=443): Read timed out. (read timeout=15)
  
  During handling of the above exception, another exception occurred:
  
  Traceback (most recent call last):
    File "./update.py", line 588, in <module>
      sys.exit(main(sys.argv[0], sys.argv[1:]))
    File "./update.py", line 563, in main
      if not github_repo(g, m):
    File "./update.py", line 61, in github_repo
      repo = g.get_repo(slug)
    File "/home/runner/.local/lib/python3.6/site-packages/github/MainClass.py", line 330, in get_repo
      headers, data = self.__requester.requestJsonAndCheck("GET", url)
    File "/home/runner/.local/lib/python3.6/site-packages/github/Requester.py", line 355, in requestJsonAndCheck
      verb, url, parameters, headers, input, self.__customConnection(url)
    File "/home/runner/.local/lib/python3.6/site-packages/github/Requester.py", line 454, in requestJson
      return self.__requestEncode(cnx, verb, url, parameters, headers, input, encode)
    File "/home/runner/.local/lib/python3.6/site-packages/github/Requester.py", line 529, in __requestEncode
      cnx, verb, url, requestHeaders, encoded_input
    File "/home/runner/.local/lib/python3.6/site-packages/github/Requester.py", line 555, in __requestRaw
      response = cnx.getresponse()
    File "/home/runner/.local/lib/python3.6/site-packages/github/Requester.py", line 133, in getresponse
      allow_redirects=False,
    File "/home/runner/.local/lib/python3.6/site-packages/requests/sessions.py", line 555, in get
      return self.request('GET', url, **kwargs)
    File "/home/runner/.local/lib/python3.6/site-packages/requests/sessions.py", line 542, in request
      resp = self.send(prep, **send_kwargs)
    File "/home/runner/.local/lib/python3.6/site-packages/requests/sessions.py", line 655, in send
      r = adapter.send(request, **kwargs)
    File "/home/runner/.local/lib/python3.6/site-packages/requests/adapters.py", line 529, in send
      raise ReadTimeout(e, request=request)
  requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='api.github.com', port=443): Read timed out. (read timeout=15)
  Error: Process completed with exit code 1.

Move cv32e40p to upstream OpenHWGroup repository?

Currently the cv32e40p data module is pulling from the Antmicro fork at https://github.com/antmicro/cv32e40p see the config below;

pythondata-auto/modules.ini

Lines 100 to 106 in 01d6bc5

[cv32e40p]
type = cpu
human_name = CV32E40P
src = https://github.com/antmicro/cv32e40p
contents = system_verilog
license = License :: OSI Approved :: Apache Software License
license_spdx = Apache-2.0

It should probably instead be pulling from https://github.com/openhwgroup/cv32e40p

GitHub Actions is failing and needs fixing due to picolibc issue

https://github.com/litex-hub/pythondata-auto/actions/runs/3222070562/jobs/5270739391

picolibc Updating

picolibc Config
picolibc Details
  picolibc 1.7.8.post528 (1, 7, 8, 528)
  Tools: 0.0.post142 (0, 0, 142)
   Data: 1.7.8.post386 (1, 7, 8, 386)
  Updating repo  litex-hub/pythondata-software-picolibc
  404 {"message": "Not Found", "documentation_url": "https://docs.github.com/rest/reference/repos#update-a-repository"}
  Cloning into 'repos/pythondata-software-picolibc'...
  Submodule 'pythondata_software_picolibc/data' (https://github.com/picolibc/picolibc) registered for path 'pythondata_software_picolibc/data'
  Cloning into '/home/runner/work/pythondata-auto/pythondata-auto/repos/pythondata-software-picolibc/pythondata_software_picolibc/data'...
  fatal: remote error: upload-pack: not our ref 580d4f13de47a3eaf66f10cfc8537721b21dfc31
  fatal: Fetched in submodule path 'pythondata_software_picolibc/data', but it did not contain 580d4f13de47a3eaf66f10cfc8537721b21dfc31. Direct fetching of that commit failed.
  Traceback (most recent call last):
    File "./update.py", line 677, in <module>
      sys.exit(main(sys.argv[0], sys.argv[1:]))
    File "./update.py", line 652, in main
      download(m)
    File "./update.py", line 84, in download
      subprocess_check_call(cmd.split())
    File "./update.py", line 27, in subprocess_check_call
      return subprocess.check_call(*args, **kw)
    File "/usr/lib/python3.6/subprocess.py", line 311, in check_call
      raise CalledProcessError(retcode, cmd)
  subprocess.CalledProcessError: Command '['git', 'clone', '--recursive', 'https://github.com/litex-hub/pythondata-software-picolibc.git', 'repos/pythondata-software-picolibc']' returned non-zero exit status 128.
  Error: Process completed with exit code 1.

picolibc version is being calculated wrong?

Uploading distributions to https://upload.pypi.org/legacy/
Uploading pythondata-software-picolibc-0.0.post21344.tar.gz
  [('type', 'software'),
   ('human_name',
    'picolibc - a C library designed for embedded 32- and 64- bit systems.'),
   ('src', 'https://github.com/picolibc/picolibc'),
   ('branch', 'main'),
   ('contents', 'data'),
   ('submodule', 'True'),
   ('license', 'License :: OSI Approved :: BSD License'),
   ('license_spdx', 'BSD-3-Clause'),
   ('tool_version', '0.0.post105'),
   ('tool_version_tuple', '(0, 0, 105)'),
   ('name', 'picolibc'),
   ('repo', 'pythondata-software-picolibc'),
   ('repo_url', 'https://github.com/litex-hub/pythondata-software-picolibc.git'),
   ('repo_https',
    'https://github.com/litex-hub/pythondata-software-picolibc.git'),
   ('py', 'pythondata_software_picolibc'),
   ('dir', 'pythondata_software_picolibc/data'),
   ('src_local',
    '/home/runner/work/pythondata-auto/pythondata-auto/srcs/pythondata-software-picolibc'),
   ('data_git_describe', 'v0.0-21239-g53567cf82'),
   ('data_git_hash', '53567cf82b92f1bd777ed57111232a110666b4df'),
   ('data_version_tuple', '(0, 0, 21239)'),
   ('data_version', '0.0.post21239'),
   ('git_msg',
    'commit 53567cf82b92f1bd777ed57111232a110666b4df\n'
    'Author: Keith Packard <[email protected]>\n'
    'Date:   Mon Oct 4 13:00:45 2021 -0700\n'
    '\n'
    "    Use expr ':' instead of 'substr' operator\n"
    '    \n'
    "    Mac OS X expr doesn't have the substr operator, so use regex with ':'\n"
    '    instead.\n'
    '    \n'
    '    Signed-off-by: Keith Packard <[email protected]>\n'),
   ('version', '0.0.post21344'),
   ('version_tuple', '(0, 0, 21344)')]

Screenshot from 2021-10-05 13-32-10

Issue with symbolic links in the pythondata_cpu_cva6

warning: unable to access 'pythondata_cpu_cva6/system_verilog/corev_apu/fpga-support/synth/BramDwc/.gitignore': Too many levels of symbolic links
warning: unable to access 'pythondata_cpu_cva6/system_verilog/corev_apu/fpga-support/behav/BramDwc/.gitignore': Too many levels of symbolic links

ValueError: invalid interpolation syntax in XXX

ibex Config
ibex

Cloning into bare repository 'srcs/pythondata-misc-opentitan'...
Traceback (most recent call last):
  File "./update.py", line 588, in <module>
    sys.exit(main(sys.argv[0], sys.argv[1:]))
  File "./update.py", line 540, in main
    get_src(m)
  File "./update.py", line 210, in get_src
    module_data['git_msg'] = git_msg
  File "/usr/lib/python3.6/configparser.py", line 1238, in __setitem__
    return self._parser.set(self._name, key, value)
  File "/usr/lib/python3.6/configparser.py", line 1193, in set
    super().set(section, option, value)
  File "/usr/lib/python3.6/configparser.py", line 894, in set
    value)
  File "/usr/lib/python3.6/configparser.py", line 402, in before_set
    "position %d" % (value, tmp_value.find('%')))
ValueError: invalid interpolation syntax in 'commit b209267af8a08ffc34879ecd3fb88e38f165cd63\nAuthor: Srikrishna Iyer <[email protected]>\nDate:   Tue Oct 12 15:54:00 2021 -0700\n\n    [dv, clk_rst_if] Improve jitter and add scaling\n    \n    - Cleanup existing code / comments\n    - Replace `ifdef VERILATOR` with existing macros\n    - Add support for randomly scaling the frequency on each edge with +-\n    %tage over the initially set frequency\n    - Improve jitter generation - use `$urandom` instead of\n    `std::randomize`.\n    - Fix jitter generation bug where the originally set clk hi and lo half\n    periods get modified\n    \n    Signed-off-by: Srikrishna Iyer <[email protected]>\n' at position 359
Error: Process completed with exit code 1.

Invalid LICENSE in pythondata-cpu-vexriscv

There's only a generic LICENSE file without a copyright:
https://github.com/litex-hub/pythondata-cpu-vexriscv/blob/a17f86c94c11dabb4be5e3f63a90e0b65fc8dec5/LICENSE#L1
while there's a correct one in the source repository:
https://github.com/SpinalHDL/VexRiscv/blob/68e704f3092be640aa92c876cf78702a83167f94/LICENSE#L3

The repository is specified with gen_src instead of src:

gen_src = https://github.com/SpinalHDL/VexRISCV.git

so perhaps that's why the original LICENSE file hasn't been added to the repository?

"Not Found" errors in the CI output

https://github.com/litex-hub/pythondata-auto/runs/3828717785?check_suite_focus=true#step:5:947

tapcfg Config
tapcfg

Updating repo  litex-hub/pythondata-cpu-lm32
404 {"message": "Not Found", "documentation_url": "https://docs.github.com/rest/reference/repos#update-a-repository"}

lm32 Config
lm32

Updating repo  litex-hub/pythondata-cpu-minerva
404 {"message": "Not Found", "documentation_url": "https://docs.github.com/rest/reference/repos#update-a-repository"}

minerva Config
minerva

Updating repo  litex-hub/pythondata-cpu-microwatt
404 {"message": "Not Found", "documentation_url": "https://docs.github.com/rest/reference/repos#update-a-repository"}

microwatt Config
microwatt

Updating repo  litex-hub/pythondata-cpu-mor1kx
404 {"message": "Not Found", "documentation_url": "https://docs.github.com/rest/reference/repos#update-a-repository"}

mor1kx Config
mor1kx

Updating repo  litex-hub/pythondata-cpu-picorv32
404 {"message": "Not Found", "documentation_url": "https://docs.github.com/rest/reference/repos#update-a-repository"}

picorv32 Config
picorv32

Updating repo  litex-hub/pythondata-cpu-rocket
404 {"message": "Not Found", "documentation_url": "https://docs.github.com/rest/reference/repos#update-a-repository"}

rocket Config
rocket

Updating repo  litex-hub/pythondata-cpu-vexriscv
404 {"message": "Not Found", "documentation_url": "https://docs.github.com/rest/reference/repos#update-a-repository"}

vexriscv Config
vexriscv

Updating repo  litex-hub/pythondata-cpu-serv
404 {"message": "Not Found", "documentation_url": "https://docs.github.com/rest/reference/repos#update-a-repository"}

serv Config
serv

Updating repo  litex-hub/pythondata-cpu-cv32e40p
404 {"message": "Not Found", "documentation_url": "https://docs.github.com/rest/reference/repos#update-a-repository"}

cv32e40p Config
cv32e40p

Updating repo  litex-hub/pythondata-cpu-ibex
404 {"message": "Not Found", "documentation_url": "https://docs.github.com/rest/reference/repos#update-a-repository"}

ibex Config
ibex

Updating repo  litex-hub/pythondata-misc-opentitan
404 {"message": "Not Found", "documentation_url": "https://docs.github.com/rest/reference/repos#update-a-repository"}

opentitan Config
opentitan

Updating repo  litex-hub/pythondata-software-picolibc
404 {"message": "Not Found", "documentation_url": "https://docs.github.com/rest/reference/repos#update-a-repository"}

picolibc Config
picolibc

Updating repo  litex-hub/pythondata-misc-tapcfg
404 {"message": "Not Found", "documentation_url": "https://docs.github.com/rest/reference/repos#update-a-repository"}

tapcfg Config
tapcfg

Drop python2 support

LiteX has always only supported Python 3, so I'm unsure why I even added Python 2 support in the first place? Python 2 is also now end-of-lifed, so we shouldn't be uploading packages for it to PyPi.

Autopush broken due to conversion from master to main on some upstream repos

Cloning into bare repository 'srcs/pythondata-cpu-serv'...
fatal: ambiguous argument 'master': unknown revision or path not in the working tree.
Use '--' to separate paths from revisions, like this:
'git <command> [<revision>...] -- [<file>...]'
Traceback (most recent call last):
  File "./update.py", line 559, in <module>
    sys.exit(main(sys.argv[0], sys.argv[1:]))
  File "./update.py", line 511, in main
    get_src(m)
  File "./update.py", line 193, in get_src
    git_hash = get_hash(module_data['branch'], env)
  File "./update.py", line 125, in get_hash
    env=env).decode('utf-8').strip()
  File "/usr/lib/python3.6/subprocess.py", line 356, in check_output
    **kwargs).stdout
  File "/usr/lib/python3.6/subprocess.py", line 438, in run
    output=stdout, stderr=stderr)
subprocess.CalledProcessError: Command '['git', 'rev-parse', 'master']' returned non-zero exit status 128.
Error: Process completed with exit code 1.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.