svn-fast-export.py crashes with too many open files

Bug #273361 reported by Barry Warsaw
18
This bug affects 3 people
Affects Status Importance Assigned to Milestone
Bazaar Fast Import
Invalid
High
Jelmer Vernooij

Bug Description

bzr --version on Gentoo says 1.7rc1
bzr revno on fastimport says 85

Exporting revision 5103... Traceback (most recent call last):
  File "/home/barry/projects/fastimport/exporters/svn-fast-export.py", line 217, in <module>
  File "/usr/lib/svn-python/svn/core.py", line 288, in run_app
  File "/home/barry/projects/fastimport/exporters/svn-fast-export.py", line 172, in crawl_revisions
  File "/home/barry/projects/fastimport/exporters/svn-fast-export.py", line 106, in export_revision
  File "/usr/lib/svn-python/libsvn/fs.py", line 383, in svn_fs_is_dir
svn.core.SubversionException: ("Can't open file '/home/repos/wooz/db/revs/5103': Too many open files", 24)

Related branches

Revision history for this message
Ian Clatworthy (ian-clatworthy) wrote :

I've seen this before and believe it's non-trivial to fix. It may well be a bug in the python bindings to svn?

Try svn-fast-export.c instead. It has worked for e in the past when I've encountered this bug in the python script.

Revision history for this message
Barry Warsaw (barry) wrote :

Unfortunately, I've not been successful building svn-fast-export.c under Hardy. I will try to paste the build errors a little later.

Changed in bzr-fastimport:
importance: Undecided → Low
status: New → Confirmed
tags: added: other-exporters
Changed in bzr-fastimport:
importance: Low → High
Revision history for this message
Peter Connolly (peterc-alembixengineering) wrote :
Download full text (3.4 KiB)

Similar problem under Jaunty Jackalope w/Bazaar 2.0.1 & fast-import 0.9.0dev

Exporting revision 535... done!
Exporting revision 536... /var/lib/python-support/python2.6/svn/core.py:52: DeprecationWarning: BaseException.message has been deprecated as of Python 2.6
Traceback (most recent call last):
  File "/home/peterc/.bazaar/plugins/fastimport/exporters/svn-fast-export.py", line 225, in <module>
  File "/var/lib/python-support/python2.6/svn/core.py", line 288, in run_app
  File "/home/peterc/.bazaar/plugins/fastimport/exporters/svn-fast-export.py", line 172, in crawl_revisions
  File "/home/peterc/.bazaar/plugins/fastimport/exporters/svn-fast-export.py", line 119, in export_revision
  File "/home/peterc/.bazaar/plugins/fastimport/exporters/svn-fast-export.py", line 30, in dump_file_blob
  File "/var/lib/python-support/python2.6/libsvn/fs.py", line 588, in svn_fs_file_contents
svn.core.SubversionException: ("Can't open file 'var/svn/db/revs/471': Too many open files", 24)
Error in sys.excepthook:
Traceback (most recent call last):
  File "/usr/lib/python2.6/dist-packages/apport_python_hook.py", line 38, in apport_excepthook
ImportError: No module named packaging_impl

Original exception was:
Traceback (most recent call last):
  File "/home/peterc/.bazaar/plugins/fastimport/exporters/svn-fast-export.py", line 225, in <module>
  File "/var/lib/python-support/python2.6/svn/core.py", line 288, in run_app
  File "/home/peterc/.bazaar/plugins/fastimport/exporters/svn-fast-export.py", line 172, in crawl_revisions
  File "/home/peterc/.bazaar/plugins/fastimport/exporters/svn-fast-export.py", line 119, in export_revision
  File "/home/peterc/.bazaar/plugins/fastimport/exporters/svn-fast-export.py", line 30, in dump_file_blob
  File "/var/lib/python-support/python2.6/libsvn/fs.py", line 588, in svn_fs_file_contents
svn.core.SubversionException: ("Can't open file 'var/svn/db/revs/471': Too many open files", 24)
Export to majorplanet.fi exited with error code 1.
peterc@wimpey-ubuntu:~$ bzr --version
Bazaar (bzr) 2.0.1
  Python interpreter: /usr/bin/python 2.6.2
  Python standard library: /usr/lib/python2.6
  Platform: Linux-2.6.28-14-generic-x86_64-with-Ubuntu-9.04-jaunty
  bzrlib: /usr/lib/python2.6/dist-packages/bzrlib
  Bazaar configuration: /home/peterc/.bazaar
  Bazaar log file: /home/peterc/.bzr.log

Copyright 2005, 2006, 2007, 2008, 2009 Canonical Ltd.
http://bazaar-vcs.org/

bzr comes with ABSOLUTELY NO WARRANTY. bzr is free software, and
you may use, modify and redistribute it under the terms of the GNU
General Public License version 2 or later.

peterc@wimpey-ubuntu:~$ cat /etc/issue
Ubuntu 9.04 \n \l

peterc@wimpey-ubuntu:~$ bzr plugins
bzrtools 2.0.0
    Various useful commands for working with bzr.

cvsps_import
    A plugin for converting from CVS to bzr using a cvsps changeset listing.

email
    Sending emails upon commit with information about the commit.

fastimport 0.9.0dev
    FastImport Plugin

launchpad 2.0.1
    Launchpad.net integration plugin for Bazaar.

netrc_credential_store 2.0.1
    Use ~/.netrc as a credential store for authentication.conf.

pqm 1.3.0
    Functionality for controlling a Patch Queue Manager (pqm).

sear...

Read more...

Jelmer Vernooij (jelmer)
Changed in bzr-fastimport:
status: Confirmed → In Progress
assignee: nobody → Jelmer Vernooij (jelmer)
Revision history for this message
Jelmer Vernooij (jelmer) wrote :

I'm closing this as invalid as bzr-fastimport is no longer shipping fastexporters for other version control systems.

Changed in bzr-fastimport:
status: In Progress → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.