UTF8 Encoding problem - With good examples

UTF-8 is a character encoding that represents each character in a text document as a unique numerical code. The problem with UTF-8 encoding can occur when a system or program that is not set up to handle UTF-8 characters attempts to read or process a document that uses them.

Example: Let's say you have a document that contains the letter "é" (e with an acute accent). If the system or program you are using to read or process the document is not set up to handle UTF-8 characters, it may display the letter as "�" (a replacement character) instead of "é".

Another example is when you have a CSV file and your system can't handle the encoding. When you try to open the file in Excel, it may show special characters as garbage values. To fix this in Excel, use Data > From Text/CSV, select the file, and set the File Origin to 65001: Unicode (UTF-8) before loading.

To solve this problem in PHP, ensure your scripts explicitly declare UTF-8 and use multibyte-safe functions. Avoid converting to ASCII, as it cannot represent extended characters. Instead, use mb_convert_encoding or iconv to standardize the encoding:

<?php
$rawData = file_get_contents('input.csv');
// Convert from ISO-8859-1 to UTF-8
$utf8Data = mb_convert_encoding($rawData, 'UTF-8', 'ISO-8859-1');
file_put_contents('output.csv', $utf8Data);
?>

Also, verify that your database connections and HTML headers declare UTF-8 to prevent mismatched encoding issues.