WordPress.org

Make WordPress Core

Opened 6 years ago

Closed 6 years ago

Last modified 6 years ago

#4421 closed defect (bug) (fixed)

MT and WP Importers memory usage 2.3 fixes

Reported by: ryan Owned by: ryan
Priority: normal Milestone: 2.3
Component: Administration Version: 2.2
Severity: normal Keywords: import importer memory performance
Cc:

Description

Most of the importers slurp entire files into memory and store the results of parsing into memory, making for a big footprint. They also use lots of unnecessary regular expressions. Importers should parse files one line at a time and write posts to the DB as they are processed to help keep us within memory limits.

Attachments (2)

mt.diff (16.4 KB) - added by ryan 6 years ago.
Reworked MT importer
import-memory-reduction-r6606.patch (2.1 KB) - added by tellyworth 6 years ago.

Download all attachments as: .zip

Change History (7)

ryan6 years ago

Reworked MT importer

comment:1 ryan6 years ago

(In [5684]) MT importer rework. see #4421

comment:2 tellyworth6 years ago

import-memory-reduction-r6606.patch reduces memory usage in the WP importer by avoiding the use of file(). It still doesn't process entries one by one, but it's a start.

comment:3 ryan6 years ago

(In [5802]) Don't slurp in entire file. Props tellyworth. see #4421

comment:4 foolswisdom6 years ago

  • Resolution set to fixed
  • Status changed from new to closed
  • Summary changed from Importers are memory hungry to MT and WP Importers memory performance 2.3 fixes

comment:5 foolswisdom6 years ago

  • Summary changed from MT and WP Importers memory performance 2.3 fixes to MT and WP Importers memory usage 2.3 fixes
Note: See TracTickets for help on using tickets.