Bazaar

svn import to bazaar stuck at "Fetching revisions:Inserting stream:Estimate"

Bug #1779572 reported by Adam Reviczky
18
This bug affects 3 people
Affects Status Importance Assigned to Milestone
Bazaar
New
Undecided
Unassigned
Launchpad itself
Fix Released
High
Colin Watson

Bug Description

Since 8 June the code import from an svn repository into launchpad's bazaar is stuck at:
Fetching revisions:Inserting stream:Estimate 7/*

The full error then is:

Traceback (most recent call last):
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/scripts/code-import-worker.py", line 106, in <module>
    sys.exit(script.main())
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/scripts/code-import-worker.py", line 101, in main
    return import_worker.run()
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/lib/lp/codehosting/codeimport/worker.py", line 543, in run
    return self._doImport()
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/lib/lp/codehosting/codeimport/worker.py", line 772, in _doImport
    self.pushBazaarBranch(bazaar_branch)
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/lib/lp/codehosting/codeimport/worker.py", line 602, in pushBazaarBranch
    stacked_on_url=self.source_details.stacked_on_url)
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/lib/lp/codehosting/codeimport/worker.py", line 250, in push
    pull_result = remote_branch.pull(bzr_branch, overwrite=True)
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/branch.py", line 1111, in pull
    possible_transports=possible_transports, *args, **kwargs)
  File "<string>", line 4, in pull_write_locked
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/branch.py", line 3306, in pull
    merge_tags_to_master=not source_is_master)
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/branch.py", line 3441, in _pull
    graph=graph)
  File "<string>", line 4, in _update_revisions_write_locked
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/branch.py", line 3249, in _update_revisions
    self.fetch(stop_revision=stop_revision)
  File "<string>", line 4, in fetch_write_locked
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/branch.py", line 3226, in fetch
    fetch_spec=fetch_spec)
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/vf_repository.py", line 1268, in fetch
    find_ghosts=find_ghosts, fetch_spec=fetch_spec)
  File "<string>", line 4, in fetch_write_locked
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/vf_repository.py", line 2585, in fetch
    find_ghosts=find_ghosts)
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/fetch.py", line 77, in __init__
    self.__fetch()
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/fetch.py", line 104, in __fetch
    self._fetch_everything_for_search(search_result)
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/fetch.py", line 132, in _fetch_everything_for_search
    stream, from_format, [])
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/vf_repository.py", line 2043, in insert_stream
    src_format, is_resume)
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/vf_repository.py", line 2107, in insert_stream_without_locking
    self.target_repo.texts.insert_record_stream(substream)
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/groupcompress.py", line 1643, in insert_record_stream
    for _ in self._insert_record_stream(stream, random_id=False):
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/groupcompress.py", line 1762, in _insert_record_stream
    [(None, len(bytes))], bytes)[0]
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/repofmt/pack_repo.py", line 1991, in add_raw_records
    raw_data[offset:offset+size], [])
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/pack.py", line 163, in add_bytes_record
    self.write_func(bytes)
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/pack.py", line 135, in write_func
    self._write_func(bytes)
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/repofmt/groupcompress_repo.py", line 153, in _write_data
    _write(bytes)
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/transport/__init__.py", line 277, in write
    osutils.pump_string_file(bytes, self.file_handle)
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/osutils.py", line 743, in pump_string_file
    write(segment)
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/paramiko/file.py", line 402, in write
    self._write_all(data)
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/paramiko/file.py", line 519, in _write_all
    count = self._write(data)
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/paramiko/sftp_file.py", line 203, in _write
    t, msg = self.sftp._read_response(req)
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/paramiko/sftp_client.py", line 810, in _read_response
    t, data = self._read_packet()
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/paramiko/sftp.py", line 174, in _read_packet
    x = self._read_all(4)
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/paramiko/sftp.py", line 158, in _read_all
    x = self.sock.recv(n)
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/transport/ssh.py", line 207, in recv
    return self.__socket.recv(n)
  File "/srv/importd.launchpad.net/production/launchpad-rev-18704/env/local/lib/python2.7/site-packages/bzrlib/transport/ssh.py", line 741, in recv
    return self._sock.recv(count)
KeyboardInterrupt
Import failed:
Traceback (most recent call last):
Failure: twisted.internet.error.TimeoutError: User timeout caused connection failure.

See code import: https://code.launchpad.net/~reviczky/texlive/trunk

Tags: qa-ok bzr svn

Related branches

lp://qastaging/~cjwatson/launchpad/code-import-push-bzr-ssh
William Grant: Approve (code)
Diff: 61 lines (+29/-3)
2 files modified
lib/lp/codehosting/codeimport/tests/test_worker.py (+17/-0)
lib/lp/codehosting/codeimport/worker.py (+12/-3)
Revision history for this message
Adam Reviczky (reviczky) wrote :

Link to the log: http://launchpadlibrarian.net/376648742/reviczky-texlive-trunk.log

Revision history for this message
Adam Reviczky (reviczky) wrote :

fresh imports are also affected:
https://code.launchpad.net/~reviczky/luatex/metapost

Revision history for this message
Qwerty Chouskie (asdfghrbljzmkd) wrote :

https://code.launchpad.net/~stk/stk/stk-assets and https://code.launchpad.net/~stk/stk/trunk affected (note the latter is a git-to-bzr import).

Changed in launchpad:
status: New → Confirmed
Changed in bzr:
status: New → Confirmed
Revision history for this message
Colin Watson (cjwatson) wrote :

I can reproduce this when pushing to the Bazaar branch store using sftp, but not when pushing using bzr+ssh. The latter is generally a better protocol anyway, so I think we should just switch to that.

Changed in launchpad:
assignee: nobody → Colin Watson (cjwatson)
importance: Undecided → High
status: Confirmed → In Progress
Qwerty Chouskie (asdfghrbljzmkd)
Changed in bzr:
status: Confirmed → New
Revision history for this message
Launchpad QA Bot (lpqabot) wrote :

Fixed in stable r18752 <http://bazaar.launchpad.net/~launchpad-pqm/launchpad/stable/revision/18752>.

tags: added: qa-needstesting
Changed in launchpad:
status: In Progress → Fix Committed
Colin Watson (cjwatson)
tags: added: qa-ok
removed: qa-needstesting
Revision history for this message
Colin Watson (cjwatson) wrote :

Fixed, and all the imports I saw mentioned here are working again.

Changed in launchpad:
status: Fix Committed → Fix Released
Revision history for this message
Qwerty Chouskie (asdfghrbljzmkd) wrote :

Thanks!

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Related questions

Remote bug watches

Bug watches keep track of this bug in other bug trackers.