| 2014-12-21 01:53:22 |
Sergey "Shnatsel" Davidoff |
bug |
|
|
added bug |
| 2014-12-21 01:55:55 |
Sergey "Shnatsel" Davidoff |
summary |
Copying a lot of files slows to a crawl |
Copying a lot of files slows to a crawl over time |
|
| 2014-12-23 05:25:26 |
PerfectCarl |
bug |
|
|
added subscriber PerfectCarl |
| 2014-12-24 12:05:37 |
Jeremy Wootten |
pantheon-files: importance |
Undecided |
High |
|
| 2014-12-24 21:55:44 |
Sergey "Shnatsel" Davidoff |
pantheon-files: status |
New |
Confirmed |
|
| 2015-02-18 14:54:45 |
Jeremy Wootten |
summary |
Copying a lot of files slows to a crawl over time |
Copying a lot of files slows to a crawl over time [$100] |
|
| 2015-02-20 11:32:21 |
Launchpad Janitor |
branch linked |
|
lp:~cmm2/pantheon-files/fix-1404588 |
|
| 2015-02-22 09:07:48 |
Jeremy Wootten |
pantheon-files: assignee |
|
cmm2 (cmm2) |
|
| 2015-02-22 09:07:56 |
Jeremy Wootten |
pantheon-files: milestone |
|
freya-rc1 |
|
| 2015-02-22 15:53:16 |
Sergey "Shnatsel" Davidoff |
description |
Copying a lot of files via Pantheon Files becomes slower and slower over time.
I've created 250,000 100-byte files on tmpfs for testing, and kicked off copying to another tmpfs. It started off at speeds over 100Kb/s but halfway through it's just 4Kb/s (!) and dropping.
Profiling with sysprof shows that all this time is spent in g_list_last(), which probably means that we're abusing a linked list somewhere and that it has to walk the entire list of already copied files, one by one, for each next file copied.
Testcase:
sudo mount -t tmpfs -o size=1G,mode=0777 tmpfs ~/created-files
sudo mount -t tmpfs -o size=1G,mode=0777 tmpfs ~/copy-here
cd created-files
split -b 100 SOME-BIG-FILE
# open Pantheon Files and copy "created-files" folder into "copy-here"
This is a synthetic test case, but I had over 250,000 files during my last backup for OS reinstallation, so this *is* a real-life scenario.
ProblemType: Bug
DistroRelease: elementary OS 0.3
Package: pantheon-files 0.1.5.1+r1680+pkg35~ubuntu0.3.1 [origin: LP-PPA-elementary-os-daily]
ProcVersionSignature: Ubuntu 3.13.0-43.72-generic 3.13.11.11
Uname: Linux 3.13.0-43-generic x86_64
ApportVersion: 2.14.1-0ubuntu3.6
Architecture: amd64
CrashDB: pantheon_files
CurrentDesktop: Pantheon
Date: Sun Dec 21 04:42:10 2014
ExecutablePath: /usr/bin/pantheon-files
GsettingsChanges:
InstallationDate: Installed on 2014-12-10 (10 days ago)
InstallationMedia: elementary OS 0.3 "Freya" - Daily amd64 (20141209)
SourcePackage: pantheon-files
UpgradeStatus: No upgrade log present (probably fresh install) |
Copying a lot of files via Pantheon Files becomes slower and slower over time.
I've created 250,000 100-byte files on tmpfs for testing, and kicked off copying to another tmpfs. It started off at speeds over 100Kb/s but halfway through it's just 4Kb/s (!) and dropping.
Profiling with sysprof shows that all this time is spent in g_list_last(), which probably means that we're abusing a linked list somewhere and that it has to walk the entire list of already copied files, one by one, for each next file copied.
Testcase:
mkdir ~/created-files ~/copy-here
sudo mount -t tmpfs -o size=1G,mode=0777 tmpfs ~/created-files
sudo mount -t tmpfs -o size=1G,mode=0777 tmpfs ~/copy-here
cd created-files
split -b 100 SOME-BIG-FILE
# open Pantheon Files and copy "created-files" folder into "copy-here"
This is a synthetic test case, but I had over 250,000 files during my last backup for OS reinstallation, so this *is* a real-life scenario.
ProblemType: Bug
DistroRelease: elementary OS 0.3
Package: pantheon-files 0.1.5.1+r1680+pkg35~ubuntu0.3.1 [origin: LP-PPA-elementary-os-daily]
ProcVersionSignature: Ubuntu 3.13.0-43.72-generic 3.13.11.11
Uname: Linux 3.13.0-43-generic x86_64
ApportVersion: 2.14.1-0ubuntu3.6
Architecture: amd64
CrashDB: pantheon_files
CurrentDesktop: Pantheon
Date: Sun Dec 21 04:42:10 2014
ExecutablePath: /usr/bin/pantheon-files
GsettingsChanges:
InstallationDate: Installed on 2014-12-10 (10 days ago)
InstallationMedia: elementary OS 0.3 "Freya" - Daily amd64 (20141209)
SourcePackage: pantheon-files
UpgradeStatus: No upgrade log present (probably fresh install) |
|
| 2015-02-23 01:00:20 |
Danielle Foré |
pantheon-files: status |
Confirmed |
In Progress |
|
| 2015-03-01 07:56:02 |
Jeremy Wootten |
branch unlinked |
lp:~cmm2/pantheon-files/fix-1404588 |
|
|
| 2015-03-01 07:57:42 |
Jeremy Wootten |
summary |
Copying a lot of files slows to a crawl over time [$100] |
Copying files is slow and slows to a crawl over time for large numbers of files [$100] |
|
| 2015-03-01 07:58:20 |
Jeremy Wootten |
pantheon-files: status |
In Progress |
Confirmed |
|
| 2015-03-01 07:58:25 |
Jeremy Wootten |
pantheon-files: assignee |
cmm2 (cmm2) |
|
|
| 2015-03-01 07:58:46 |
Jeremy Wootten |
pantheon-files: milestone |
freya-rc1 |
|
|
| 2015-03-01 08:04:35 |
Jeremy Wootten |
bug |
|
|
added subscriber Jeremy Wootten |
| 2015-03-01 08:20:46 |
Jeremy Wootten |
summary |
Copying files is slow and slows to a crawl over time for large numbers of files [$100] |
Copying files is slow and slows to a crawl over time for large numbers of files [$200] |
|
| 2015-03-01 09:01:13 |
RabbitBot |
pantheon-files: status |
Confirmed |
Fix Committed |
|
| 2015-03-01 09:13:31 |
Cody Garver |
pantheon-files: milestone |
|
freya-rc1 |
|
| 2015-03-01 09:15:17 |
Cody Garver |
branch linked |
|
lp:~cmm2/pantheon-files/fix-1404588 |
|
| 2015-03-25 11:10:31 |
Jeremy Wootten |
pantheon-files: status |
Fix Committed |
Confirmed |
|
| 2015-03-25 11:33:10 |
Cody Garver |
pantheon-files: milestone |
freya-rc1 |
|
|
| 2015-05-03 13:44:55 |
Lime |
bug |
|
|
added subscriber Lime |
| 2015-07-11 22:52:03 |
Danielle Foré |
pantheon-files: milestone |
|
loki-beta1 |
|
| 2016-04-29 18:00:29 |
Danielle Foré |
pantheon-files: milestone |
loki-beta1 |
loki+1-beta1 |
|
| 2016-10-12 19:15:22 |
Matt Spaulding |
bug |
|
|
added subscriber Matt Spaulding |
| 2016-12-02 22:32:50 |
svan001 |
bug |
|
|
added subscriber svan001 |
| 2017-06-21 04:16:13 |
Vishal Rao |
bug |
|
|
added subscriber Vishal Rao |
| 2017-10-12 10:30:37 |
Cody Garver |
tags |
amd64 apport-bug freya performance third-party-packages |
amd64 apport-bug bounty freya performance third-party-packages |
|
