| 03:51.30 | *** join/#edev purl (~purl@rikers.org) |
| 03:51.30 | *** topic/#edev is Discussion of embedded systems (Hardware/Software/Linux/Commercial Device Repurposing) : Busybox and Buildroot : http://www.elinux.org : Logs available at ibot.rikers.org |
| 03:56.33 | *** join/#edev mbuf (user@nat/redhat/x-vdhixghnkhkumwct) |
| 04:14.57 | *** join/#edev TheSeven (~quassel@rockbox/developer/TheSeven) |
| 06:56.45 | *** join/#edev MonMotha (~monmotha@2001:470:c5f2:1:224:7eff:fedc:893e) |
| 07:09.47 | *** join/#edev clio (~andrej@85.159.109.222) |
| 08:57.50 | *** join/#edev florian_kc (~fuchs@port-217-146-132-69.static.qsc.de) |
| 08:57.50 | *** join/#edev florian_kc (~fuchs@Maemo/community/contributor/florian) |
| 09:22.08 | *** join/#edev quentin_ (52ee9198@gateway/web/freenode/ip.82.238.145.152) |
| 09:22.18 | quentin_ | hello |
| 09:24.55 | quentin_ | I have some problem with character encoding in filename on my embedded linux. Accented char are replace with "?" |
| 09:30.49 | keesj | quentin_: there are a lot of thing that can go wrong here |
| 09:31.16 | keesj | what file system are you using? |
| 09:32.22 | keesj | also the problem can be in one of the following , if in a terminal the configured encoding , the file systme itself and sometimes even just the install fonts |
| 09:34.49 | quentin_ | I have the problem if I use nfs or if I mount the system on nand (jffs2) |
| 09:35.05 | keesj | first determine what encoding your files are supposed to be (this depends on the file system . FAT and crap also need to know the current "pagetable" to determine the thing to be displayed , next once you know you encoding do a ls | od to determine if the character is right , if that all works . it's probably your terminal that has wrong settings (*e.g. not utf-8) |
| 09:35.51 | keesj | and how do you know you have a problem ( what tools do you use to determine that you have a problem?) |
| 09:37.53 | keesj | I don't know much about nfs in relation of char encodings but you might want to try: http://nixcraft.com/file-servers/15729-nfs-character-encoding.html . first try to answer my question. |
| 09:41.02 | quentin_ | well, I know I have a problem because I have a program that make recursive copy of file/folder and when trying to copy file without "accented charr" the program stop. I m going to investigate exactly why. But this same cade was working fine on a previous linux (currently on 3.x, before was on 2.6) |
| 09:43.20 | keesj | I see |
| 09:56.02 | quentin_ | Is there a way to see the system encoding on the embedded linux ? |
| 09:58.40 | keesj | I don't think there is really such a thing (hence my question). if you are running the script from a shell encoding might depend on env variables. (as soon as the shell is involved actually). |
| 09:59.24 | keesj | for file system like FAT you need additional kernel modules (NLS stuff) to not mess up the file names. |
| 10:00.33 | keesj | My understanding is that the kernel is mostly agnostic to encoding (it just handles null terminated strings) but file system. |
| 10:00.47 | keesj | might be different. |
| 10:00.47 | quentin_ | well, the file I normally process are on usb key, so yes in FAT |
| 10:01.58 | keesj | try reading here: http://blog.flameeyes.eu/2008/08/locales-nls-kernels-and-filesystems you might indeed be missing nls modules |
| 10:02.13 | quentin_ | but I have nls_ascii (and nls_cp437) loaded and the file I m currently checking with nfs is in us_ascii encoding |
| 10:04.59 | keesj | that's all I know. good luck ! |
| 10:06.35 | quentin_ | thanks for your help ^^ |
| 10:16.10 | *** join/#edev gustavoz (~gustavoz@190.226.72.155) |
| 11:25.30 | *** join/#edev g1powermac (~g1powerma@rrcs-74-87-150-6.west.biz.rr.com) |
| 11:25.31 | *** join/#edev g1powermac (~g1powerma@unaffiliated/g1powermac) |
| 11:28.58 | *** join/#edev JoeLlama (~snork@unaffiliated/joellama) |
| 12:39.42 | quentin_ | on my embedded linux, readdir() seems to be enable to read filename "accented char", it replace all of them with "?" |
| 12:40.13 | quentin_ | is there on other way to enumerate the content of a folder ? |
| 12:42.52 | av500 | quentin_: ??? |
| 12:43.11 | av500 | readdir() gives you a zero terminated string |
| 12:43.29 | av500 | it makes no assumption about charset encoding |
| 12:48.59 | iospace | av500: by zero terminated you mean null terminated right? |
| 12:56.42 | av500 | ah well |
| 12:56.56 | av500 | you got me |
| 13:01.49 | iospace | :P |
| 13:04.49 | quentin_ | sorry was afk, readdirgive me a string but any accented char in this string is replaced by the cahr ? |
| 13:07.42 | quentin_ | to be more accurate, one accented char is replace by two '?' |
| 13:08.32 | quentin_ | this happen to the name of file coming from either windows / mac or linux |
| 13:11.17 | keesj | so most c functions do not handle wide chars. as these are 2 chars you are most certainly reading utf-8. |
| 13:11.47 | keesj | to check this read the data and dump is as hex (so you know if what you see is what you get) |
| 13:13.57 | keesj | perhaps look aroud for the wide char functions (wchar.h). but don't turst what you see any time. dump the value , if you are reading two chard and they are really ascii '?' |
| 13:14.10 | quentin_ | the char is replaced by 0x3F 0x3F |
| 13:15.50 | keesj | do you run from a shell? |
| 13:16.00 | quentin_ | no |
| 13:55.00 | quentin_ | I checked on an old version of my system (which run on an other module now tx28, older tx27) and one difference is that the default nls in the kernel config was iso8859-15 which now is utf8. Do you think that could from here ? And is that a value I can change without expecting side effect ? |
| 14:10.27 | *** join/#edev gustavoz (~gustavoz@host16.190-30-206.telecom.net.ar) |
| 15:15.37 | *** join/#edev dijenerate (~dijenerat@63.143.73.37) |
| 15:17.08 | *** join/#edev gustavoz (~gustavoz@190.30.206.16) |
| 15:36.02 | *** join/#edev dijenerate (~dijenerat@63.143.73.37) |
| 15:42.20 | *** join/#edev prpplague (~danders@192.94.92.14) |
| 15:42.47 | *** mode/#edev [+o prpplague] by ChanServ |
| 16:00.23 | *** join/#edev slashbeast (~slashbeas@pc-156036.zdnet.com.pl) |
| 16:00.25 | *** join/#edev slashbeast (~slashbeas@unaffiliated/slashbeast) |
| 16:09.18 | *** join/#edev dijenerate (~dijenerat@63.143.73.33) |
| 16:10.08 | *** join/#edev slashbeast (~slashbeas@unaffiliated/slashbeast) |
| 16:36.29 | *** join/#edev sndcrb (~sndcrb@dsl-hkibrasgw2-50def8-126.dhcp.inet.fi) |
| 17:06.34 | *** join/#edev dijenerate (~dijenerat@63.143.73.39) |
| 17:13.46 | *** join/#edev NightMonkey (~NightrMon@pdpc/supporter/professional/nightmonkey) |
| 17:54.23 | *** join/#edev GPSFan (~kenm@64.92.145.112) |
| 17:54.24 | *** mode/#edev [+o GPSFan] by ChanServ |
| 17:59.50 | *** join/#edev mrcan_ (~mrcan@78.173.21.150) |
| 17:59.50 | *** join/#edev mrcan_ (~mrcan@unaffiliated/mrcan) |
| 19:07.33 | *** join/#edev dijenerate (~dijenerat@199.47.52.87) |
| 19:22.21 | *** join/#edev Godfath3r (~godfath3r@ppp-94-66-148-116.home.otenet.gr) |
| 19:22.26 | *** part/#edev Godfath3r (~godfath3r@ppp-94-66-148-116.home.otenet.gr) |
| 19:30.42 | *** join/#edev flo_lap (~fuchs@sign-4db6a601.pool.mediaWays.net) |
| 19:30.43 | *** join/#edev flo_lap (~fuchs@Maemo/community/contributor/florian) |
| 20:19.53 | *** join/#edev landley (~landley@cpe-72-177-21-136.austin.res.rr.com) |
| 21:26.27 | *** join/#edev itdnhr (~quassel@64.31.59.70) |
| 22:06.37 | *** join/#edev itdnhr (~quassel@64.31.59.70) |
| 22:14.39 | *** join/#edev JoeLlama (~snork@unaffiliated/joellama) |