WordPress.org

Make WordPress Core

Opened 7 years ago

Closed 7 years ago

Last modified 7 years ago

#4421 closed defect (bug) (fixed)

MT and WP Importers memory usage 2.3 fixes

Reported by: ryan Owned by: ryan
Milestone: 2.3 Priority: normal
Severity: normal Version: 2.2
Component: Administration Keywords: import importer memory performance
Focuses: Cc:

Description

Most of the importers slurp entire files into memory and store the results of parsing into memory, making for a big footprint. They also use lots of unnecessary regular expressions. Importers should parse files one line at a time and write posts to the DB as they are processed to help keep us within memory limits.

Attachments (2)

mt.diff (16.4 KB) - added by ryan 7 years ago.
Reworked MT importer
import-memory-reduction-r6606.patch (2.1 KB) - added by tellyworth 7 years ago.

Download all attachments as: .zip

Change History (7)

ryan7 years ago

Reworked MT importer

comment:1 ryan7 years ago

(In [5684]) MT importer rework. see #4421

comment:2 tellyworth7 years ago

import-memory-reduction-r6606.patch reduces memory usage in the WP importer by avoiding the use of file(). It still doesn't process entries one by one, but it's a start.

comment:3 ryan7 years ago

(In [5802]) Don't slurp in entire file. Props tellyworth. see #4421

comment:4 foolswisdom7 years ago

  • Resolution set to fixed
  • Status changed from new to closed
  • Summary changed from Importers are memory hungry to MT and WP Importers memory performance 2.3 fixes

comment:5 foolswisdom7 years ago

  • Summary changed from MT and WP Importers memory performance 2.3 fixes to MT and WP Importers memory usage 2.3 fixes
Note: See TracTickets for help on using tickets.