problems with diacritic characters in fedora8

[Natxo Asenjo]

hi,

since fedora8 I have an awkward problem. In an xterm or console
session all diacritic characters appear like this:

http://www.asenjo.nl/Screenshot-xterm.png

that is, they are replaced by blanks. In other applications like
openoffice this is not a problem.

it is awkward because I am used to using console programs like mutt
for my email, so this is something that I come across really often.

System settings: language is English; the output of locale is:

LC_CTYPE="en_US"
LC_NUMERIC="en_US"
LC_TIME="en_US"
LC_COLLATE="en_US"
LC_MONETARY="en_US"
LC_MESSAGES="en_US"
LC_PAPER="en_US"
LC_NAME="en_US"
LC_ADDRESS="en_US"
LC_TELEPHONE="en_US"
LC_MEASUREMENT="en_US"
LC_IDENTIFICATION="en_US"
LC_ALL=

I have changed the system locale to Spanish (Spain) but it does not
help (I rebooted the system for the changes to take place).

Does anybody know where I could fix this? This has worked perfectly in
fedora6 and fedora7, so I am a bit puzzled.

[Jens-Ulrik Petersen]

Hi Natxo Asenjo,
> since fedora8 I have an awkward problem. In an xterm or console
> session all diacritic characters appear like this:
> http://www.asenjo.nl/Screenshot-xterm.png
> that is, they are replaced by blanks. In other applications like
> openoffice this is not a problem.

Sorry the screenshot doesn't help me much since I can't read Spanish - 
so I am not sure where the blanks are appearing...
> it is awkward because I am used to using console programs like mutt
> for my email, so this is something that I come across really often.
> LC_CTYPE="en_US"
> LC_NUMERIC="en_US"
> LC_TIME="en_US"
> LC_COLLATE="en_US"
> LC_MONETARY="en_US"
> LC_MESSAGES="en_US"
> LC_PAPER="en_US"
> LC_NAME="en_US"
> LC_ADDRESS="en_US"
> LC_TELEPHONE="en_US"
> LC_MEASUREMENT="en_US"
> LC_IDENTIFICATION="en_US"

Are you intentionally not using UTF-8?
> I have changed the system locale to Spanish (Spain) but it does not
> help (I rebooted the system for the changes to take place).

Ok.
> Does anybody know where I could fix this? This has worked perfectly in
> fedora6 and fedora7, so I am a bit puzzled.

So is it just a display problem in terms?

Jens

[Natxo Asenjo]

On Jan 21, 2008 1:32 AM, Jens Petersen  wrote:
> Hi Natxo Asenjo,
> > since fedora8 I have an awkward problem. In an xterm or console
> > session all diacritic characters appear like this:
> > http://www.asenjo.nl/Screenshot-xterm.png
> > that is, they are replaced by blanks. In other applications like
> > openoffice this is not a problem.
>
> Sorry the screenshot doesn't help me much since I can't read Spanish -
> so I am not sure where the blanks are appearing...

ok, fair enough:

I try to see words like (now I copy paste from openoffice):

Iňaki, espaňol, camión

and what I see is:

I aki, espa ol, cami n
> > it is awkward because I am used to using console programs like mutt
> > for my email, so this is something that I come across really often.
> > LC_CTYPE="en_US"
> > LC_NUMERIC="en_US"
> > LC_TIME="en_US"
> > LC_COLLATE="en_US"
> > LC_MONETARY="en_US"
> > LC_MESSAGES="en_US"
> > LC_PAPER="en_US"
> > LC_NAME="en_US"
> > LC_ADDRESS="en_US"
> > LC_TELEPHONE="en_US"
> > LC_MEASUREMENT="en_US"
> > LC_IDENTIFICATION="en_US"
>
> Are you intentionally not using UTF-8?

not that I know of. I use the tool in system->administration->
language and choose English (USA); I do not see English utf-8 in there
to change the locale; could you tell me where I can do that?
> > I have changed the system locale to Spanish (Spain) but it does not
> > help (I rebooted the system for the changes to take place).
>
> Ok.
> > Does anybody know where I could fix this? This has worked perfectly in
> > fedora6 and fedora7, so I am a bit puzzled.
>
> So is it just a display problem in terms?

yes, it is just a display problem in terminals (but an annoying one
for me ;-) ).

[Natxo Asenjo]

2008/1/21 Natxo Asenjo :
> On Jan 21, 2008 1:32 AM, Jens Petersen  wrote:

I noticed something else. This is the output of $ locale:
> > > LC_CTYPE="en_US"
> > > LC_NUMERIC="en_US"
> > > LC_TIME="en_US"
> > > LC_COLLATE="en_US"
> > > LC_MONETARY="en_US"
> > > LC_MESSAGES="en_US"
> > > LC_PAPER="en_US"
> > > LC_NAME="en_US"
> > > LC_ADDRESS="en_US"
> > > LC_TELEPHONE="en_US"
> > > LC_MEASUREMENT="en_US"
> > > LC_IDENTIFICATION="en_US"

and this of # locale (as root):
LANG=en_US.UTF-8
LC_CTYPE="en_US.UTF-8"
LC_NUMERIC="en_US.UTF-8"
LC_TIME="en_US.UTF-8"
LC_COLLATE="en_US.UTF-8"
LC_MONETARY="en_US.UTF-8"
LC_MESSAGES="en_US.UTF-8"
LC_PAPER="en_US.UTF-8"
LC_NAME="en_US.UTF-8"
LC_ADDRESS="en_US.UTF-8"
LC_TELEPHONE="en_US.UTF-8"
LC_MEASUREMENT="en_US.UTF-8"
LC_IDENTIFICATION="en_US.UTF-8"
LC_ALL=
> > Are you intentionally not using UTF-8?

no! if I look in /etc/sysconfig/i18n this is what I see:

LANG="en_US.UTF-8"
SYSFONT="latarcyrheb-sun16"

any more ideas? I really do not understand it. This is so ... nineties.

[naranhuu uridiinbish]

Hi
> LC_CTYPE="en_US.UTF-8"
> LC_NUMERIC="en_US.UTF-8"
> LC_TIME="en_US.UTF-8"
> LC_COLLATE="en_US.UTF-8"
> LC_MONETARY="en_US.UTF-8"
> LC_MESSAGES="en_US.UTF-8"
> LC_PAPER="en_US.UTF-8"
> LC_NAME="en_US.UTF-8"
> LC_ADDRESS="en_US.UTF-8"
> LC_TELEPHONE="en_US.UTF-8"
> LC_MEASUREMENT="en_US.UTF-8"
> LC_IDENTIFICATION="en_US.UTF-8"
> LC_ALL=

I don't know so much about it, but why "LC_ALL= " is blank? I suggest
you fill it some value. I use japanese in my fedora8 and it works fine
. My locale is like this :
(root's locale )
LANG=ja_JP.UTF-8
LC_CTYPE="ja_JP.eucJP"
LC_NUMERIC="ja_JP.eucJP"
LC_TIME="ja_JP.eucJP"
LC_COLLATE="ja_JP.eucJP"
LC_MONETARY="ja_JP.eucJP"
LC_MESSAGES="ja_JP.eucJP"
LC_PAPER="ja_JP.eucJP"
LC_NAME="ja_JP.eucJP"
LC_ADDRESS="ja_JP.eucJP"
LC_TELEPHONE="ja_JP.eucJP"
LC_MEASUREMENT="ja_JP.eucJP"
LC_IDENTIFICATION="ja_JP.eucJP"
LC_ALL=ja_JP.eucJP
(my  locale)
LANG=ja_JP.eucJP
LC_CTYPE="ja_JP.eucJP"
LC_NUMERIC="ja_JP.eucJP"
LC_TIME="ja_JP.eucJP"
LC_COLLATE="ja_JP.eucJP"
LC_MONETARY="ja_JP.eucJP"
LC_MESSAGES="ja_JP.eucJP"
LC_PAPER="ja_JP.eucJP"
LC_NAME="ja_JP.eucJP"
LC_ADDRESS="ja_JP.eucJP"
LC_TELEPHONE="ja_JP.eucJP"
LC_MEASUREMENT="ja_JP.eucJP"
LC_IDENTIFICATION="ja_JP.eucJP"
LC_ALL=ja_JP.eucJP

On Jan 22, 2008 3:52 AM, Natxo Asenjo  wrote:
> 2008/1/21 Natxo Asenjo :
> > On Jan 21, 2008 1:32 AM, Jens Petersen  wrote:
>
> I noticed something else. This is the output of $ locale:
> > > > LC_CTYPE="en_US"
> > > > LC_NUMERIC="en_US"
> > > > LC_TIME="en_US"
> > > > LC_COLLATE="en_US"
> > > > LC_MONETARY="en_US"
> > > > LC_MESSAGES="en_US"
> > > > LC_PAPER="en_US"
> > > > LC_NAME="en_US"
> > > > LC_ADDRESS="en_US"
> > > > LC_TELEPHONE="en_US"
> > > > LC_MEASUREMENT="en_US"
> > > > LC_IDENTIFICATION="en_US"
>
> and this of # locale (as root):
> LANG=en_US.UTF-8
> LC_CTYPE="en_US.UTF-8"
> LC_NUMERIC="en_US.UTF-8"
> LC_TIME="en_US.UTF-8"
> LC_COLLATE="en_US.UTF-8"
> LC_MONETARY="en_US.UTF-8"
> LC_MESSAGES="en_US.UTF-8"
> LC_PAPER="en_US.UTF-8"
> LC_NAME="en_US.UTF-8"
> LC_ADDRESS="en_US.UTF-8"
> LC_TELEPHONE="en_US.UTF-8"
> LC_MEASUREMENT="en_US.UTF-8"
> LC_IDENTIFICATION="en_US.UTF-8"
> LC_ALL=
> > > Are you intentionally not using UTF-8?
>
> no! if I look in /etc/sysconfig/i18n this is what I see:
>
> LANG="en_US.UTF-8"
> SYSFONT="latarcyrheb-sun16"
>
> any more ideas? I really do not understand it. This is so ... nineties.
>
> --
> Groeten,
> J.Asenjo
>
> --
> Fedora-i18n-list mailing list
> [e-mail]
> https://www.redhat.com/mailman/listinfo/fedora-i18n-list

[Jens-Ulrik Petersen]

Hi Natxo Asenjo,
> > > it is awkward because I am used to using console programs like mutt
> > > for my email, so this is something that I come across really often.
> > > LC_CTYPE="en_US"
> > > LC_NUMERIC="en_US"
> > > LC_TIME="en_US"
> > > LC_COLLATE="en_US"
> > > LC_MONETARY="en_US"
> > > LC_MESSAGES="en_US"
> > > LC_PAPER="en_US"
> > > LC_NAME="en_US"
> > > LC_ADDRESS="en_US"
> > > LC_TELEPHONE="en_US"
> > > LC_MEASUREMENT="en_US"
> > > LC_IDENTIFICATION="en_US"
> >
> > Are you intentionally not using UTF-8?
>
> not that I know of.

Sounds like you are somehow overriding the locale in your user 
configuration.  Perhaps you have a ~/.i18n file or set locale in your 
shell or desktop startup files?
> I use the tool in system->administration->
> language and choose English (USA);

That just sets the system locale, which seems to be ok from what you say.

Jens

[Natxo Asenjo]

On Jan 22, 2008 2:26 AM, Jens Petersen  wrote:
> Sounds like you are somehow overriding the locale in your user
> configuration.  Perhaps you have a ~/.i18n file or set locale in your
> shell or desktop startup files?

no, nothing in my .bash* over locale; how does a .i18n file look like?
I do not seem anything to find on the web regarding that and a man
search (apropos i18n)  returns only information about perl modules in
my system.

[Jens-Ulrik Petersen]

> how does a .i18n file look like?

It is just a regular shell script like "/etc/sysconf/i18n", which is 
sourced by shells if it exists in "/etc/profile.d/lang.sh".

Perhaps reading through lang.sh might give you some more clues of where 
to look.

Jens

[Jens-Ulrik Petersen]

Anyway maybe more important to you is making sure that setting the 
correct locale in your terminal fixes the character problem you're seeing.

Jens