Make WordPress Core

Opened 16 years ago

Closed 16 years ago

Last modified 16 years ago

#4421 closed defect (bug) (fixed)

MT and WP Importers memory usage 2.3 fixes

Reported by: ryan's profile ryan Owned by: ryan's profile ryan
Milestone: 2.3 Priority: normal
Severity: normal Version: 2.2
Component: Administration Keywords: import importer memory performance
Focuses: Cc:

Description

Most of the importers slurp entire files into memory and store the results of parsing into memory, making for a big footprint. They also use lots of unnecessary regular expressions. Importers should parse files one line at a time and write posts to the DB as they are processed to help keep us within memory limits.

Attachments (2)

mt.diff (16.4 KB) - added by ryan 16 years ago.
Reworked MT importer
import-memory-reduction-r6606.patch (2.1 KB) - added by tellyworth 16 years ago.

Download all attachments as: .zip

Change History (7)

@ryan
16 years ago

Reworked MT importer

#1 @ryan
16 years ago

(In [5684]) MT importer rework. see #4421

#2 @tellyworth
16 years ago

import-memory-reduction-r6606.patch reduces memory usage in the WP importer by avoiding the use of file(). It still doesn't process entries one by one, but it's a start.

#3 @ryan
16 years ago

(In [5802]) Don't slurp in entire file. Props tellyworth. see #4421

#4 @foolswisdom
16 years ago

  • Resolution set to fixed
  • Status changed from new to closed
  • Summary changed from Importers are memory hungry to MT and WP Importers memory performance 2.3 fixes

#5 @foolswisdom
16 years ago

  • Summary changed from MT and WP Importers memory performance 2.3 fixes to MT and WP Importers memory usage 2.3 fixes
Note: See TracTickets for help on using tickets.