Make WordPress Core

Opened 13 years ago

Closed 11 years ago

Last modified 11 years ago

#17487 closed defect (bug) (duplicate)

Codepage issue with the wp.org Credits API

Reported by: demetris's profile demetris Owned by: westi's profile westi
Milestone: Priority: normal
Severity: normal Version:
Component: WordPress.org Site Keywords:
Focuses: Cc:

Description

I was playing with my profile page at wp.org and changed the Name field from:

demetris

to:

demetris (Δημήτρης Κίκιζας)

What the API returns for that is:

demetris (???????? ???????)

It seems the API returns its results in ISO 8859-1. Can we change that to UTF-8?

Attachments (1)

reemplazos.php (8.4 KB) - added by bi0xid 13 years ago.
Replace LATIN1 -> UTF-8

Download all attachments as: .zip

Change History (13)

#1 @nacin
13 years ago

  • Milestone changed from Awaiting Review to WordPress.org
  • Owner set to westi
  • Status changed from new to assigned

#2 @westi
13 years ago

  • Status changed from assigned to accepted

#3 @westi
13 years ago

I spent a good amount of time looking into this and it is not an easy fix at the moment.

We have a mix of UTF8 and latin1 tables on WP.org and the api is serving data from a latin1 table.

We can revisit this later but for now I have changed the api to return the user name when we detect this.

#4 follow-up: @bi0xid
13 years ago

I have solved it changing the tables to UTF-8 and doing a "Search and Replace".

Attached FYI.

@bi0xid
13 years ago

Replace LATIN1 -> UTF-8

#5 @dd32
13 years ago

could mb_convert_encoding() be used here at all?

closed #17915 as duplicate

#6 in reply to: ↑ 4 ; follow-up: @westi
12 years ago

Replying to bi0xid:

I have solved it changing the tables to UTF-8 and doing a "Search and Replace".

Attached FYI.

While this might look like it works in only handles a subset of common case issues and doesn't really resolve the underlying issue.

We have a lot of tables and a lot of data - there have been a lot of accounts created over time on WP.org for the forums and we need to do this in a careful and reliable manner.

This is not the only manifestation of the issue and we need to work carefully to resolve them all - hopefully that will happen soon.

#7 in reply to: ↑ 6 @bi0xid
12 years ago

Replying to westi:

While this might look like it works in only handles a subset of common case issues and doesn't really resolve the underlying issue.

I know. It's just a patch for everyone who needs a quick solve while we find a good solution. These are the common cases for Spanish transformations.

#8 @nacin
12 years ago

Since some bad data was still being returned via the API due to HTML entities, there is now also a remove_accents() call on the names.

#9 @SergeyBiryukov
11 years ago

  • Component changed from General to WordPress.org site

#10 @knutsp
11 years ago

  • Cc knut@… added

#11 @samuelsidler
11 years ago

  • Milestone WordPress.org deleted
  • Status changed from accepted to closed

Migrated to #meta128.

#12 @SergeyBiryukov
11 years ago

  • Resolution set to duplicate
Note: See TracTickets for help on using tickets.