Re: ls eat high CPU time when LANG=zh_CN.UTF-8 and LC_ALL=zh_CN.UTF-8

On Mon, Jul 04, 2016 at 02:51:46PM +0800, Huang Wen Hui wrote:
> 2016-07-04 14:41 GMT+08:00 Baptiste Daroussin <bapt_at_freebsd.org>:
> 
> > On Mon, Jul 04, 2016 at 02:36:11PM +0800, Huang Wen Hui wrote:
> > > 2016-07-04 14:20 GMT+08:00 Baptiste Daroussin <bapt_at_freebsd.org>:
> > >
> > > > On Mon, Jul 04, 2016 at 11:56:36AM +0800, Huang Wen Hui wrote:
> > > > > Hi,
> > > > > On very recent CURRENT, ls can eat high CPU time when
> > LANG=zh_CN.UTF-8
> > > > and
> > > > > LC_ALL=zh_CN.UTF-8:
> > > > >
> > > > > % uname -a
> > > > > FreeBSD mbp.gddsn.org.cn 11.0-ALPHA6 FreeBSD 11.0-ALPHA6 #121
> > r302331M:
> > > > Mon
> > > > > Jul  4 10:47:27 CST 2016     root_at_mbp.gddsn.org.cn:
> > > > /usr/obj/usr/src/sys/MACBOOK
> > > > >  amd64
> > > > >
> > > > > top show:
> > > > > 4457 hwh           1 100    0 16784K  4416K CPU4    4   0:22  98.86%
> > ls
> > > > >
> > > > > any ideas?
> > > > >
> > > > Is it in all directories or only in directories with files in chinese
> > > > characters?
> > > >
> > > Yes, the  directory contain Chinese characters.
> > >
> > > >
> > > > Is it only happening when you run ls with some arguments (in particular
> > > > -l) or
> > > > with any arguments?
> > > >
> > > I use  ls -wGl
> > >
> > > >
> > > > Do you see the same if you force any other locale like en_US.UTF-8?
> > > >
> > > There is no problem if set  en_US.UTF-8.
> > >
> > >
> > > > Best regards,
> > > > Bapt
> > > >
> >
> > Can you try:
> > env -i LANG=zh_CN.UTF-8 LC_COLLATE=C ls -l
> >
> > And tell me if it still happen?
> >
> No problem with this command.
> 

Ok so there might be an very inefficient code in the new chinese collation code
I will look into it thanks a lot for reporting.

Best regards,
Bapt