Questions tagged [encoding]
A method of representing characters (such as A, 9, %, ழ, ♦, and non-printing control characters) for storage and communication. The Unicode standard provides a code point (number) for each of over 100,000 different characters, and the standard is implemented by character encodings such as UTF-8, widely used in Linux systems. The first 128 Unicode code points are the ASCII characters, which UTF-8 represents with 1 byte per character.
189
questions
43
votes
8
answers
64k
views
How can I encode and decode percent-encoded strings on the command line?
How can I encode and decode percent-encoded (URL encoded) strings on the command line?
I'm looking for a solution that can do this:
$ percent-encode "ændrük"
%C3%A6ndr%C3%BCk
$ percent-decode "%C3%...
- 77.2k
37
votes
4
answers
106k
views
How can I see which encoding is used in a file
I had some problems with subtitle files in video omxplayer. To solve it I had to convert from windows-1250 to UTF-8 encoding. My question is, how can I see for some specific file which encoding is ...
- 3,460
26
votes
6
answers
68k
views
Switch encoding of terminal with a command
One of the servers I quite often ssh to uses western encoding instead of utf-8 (and there's no way I can change that).
I've started writing a bash script to connect to this server, so I won't have to ...
- 2,932
20
votes
8
answers
53k
views
Convert Text File Encoding
I frequently encounter text files (such as subtitle files in my native language, Persian) with character encoding problems. These files are created on Windows, and saved with an unsuitable encoding (...
- 3,349
18
votes
3
answers
8k
views
Cannot delete/move files with special characters in file name
As you can see below the files have uncommon characters.
Deleting them either in the terminal or Dolphin returns the error:
No such file or directory
Running ls -la on the directory gave me this ...
- 315
15
votes
2
answers
30k
views
How to unzip a Japanese ZIP file, and avoid mojibake/garbled characters
I received a ZIP file from a Japanese customer.
When I try to unzip it the file and folders names are messed up:
$ unzip ~/Downloads/【新入荷ECM】資料.zip
...
inflating: БyРVУ№Й╫ECMБzОСЧ┐/123_ГЖБ[ГXГPБ[ГX....
- 11.7k
15
votes
4
answers
31k
views
Convert DVD to MKV (et al) without transcoding/recompression
Like a lot of people, I have a lot of DVDs. But we also have a stupid amount of disk space and a media centre (Boxee) so the DVDs are getting less and less use. It would be nice to convert our DVDs ...
Oli♦
- 295k
14
votes
5
answers
13k
views
Running a script created in Notepad (Windows) on Ubuntu
I created a Notepad file on Windows and copied it to Ubuntu. The file contains some iptables rules. After making the file executable using chmod +x and executing it, it didn't work.
However, when I ...
- 145
13
votes
3
answers
32k
views
How to rename file names to different encoding?
I have 3 types of file name encodings on reiserfs mounted hard drive: CP1251, KOI-8, UTF-8 and ASCII. I really need to convert all encodings to UTF-8, recursively. Is there any utility, which will ...
- 2,547
12
votes
3
answers
34k
views
How do I install the opus audio encoder?
I would like to try out the opus audio encoder, but can't find it in the repositories. Can anyone here help me get it installed on my computer? I have some wav files which I would like to convert to ...
- 3,987
10
votes
1
answer
377
views
ubuntu å vs osx å?
Not sure if this is a ubuntu or osx question, but I'll start here. I'll leave it to the mods to move the question to AskDifferent if more apropriate.
I moved a file from ubuntu to osx using scp on ...
- 866
9
votes
4
answers
19k
views
How to read ANSI encoded files in the right way?
I have some files that Ubuntu can't read it ( ANSI encoding ) but Windows can read it well.
When I open it in gedit or notepad++ it seems like this :
Êã ÇáÊÍæíá áÜÜ
How can I make Ubuntu read ...
- 93
9
votes
4
answers
8k
views
What players do support flac files with embeded cue sheet?
I recently got some FLAC files with embeded cue sheet. Though, the info of the sheet file doesn't seem to show up in Rhythmbox; Banshee; Amarok or Audatious. Which media players support this kind of ...
- 1,336
9
votes
0
answers
1k
views
Why does apache2 default to LANG=C instead of UTF8 or system default
The 10-year-old comment in /etc/apache2/envvars simply says "The locale used by some modules like mod_dav", but why can't mod_dav be fixed to also handle a better LANG setting for the rest of apache?
- 3,216
8
votes
4
answers
21k
views
Character encoding problem with filenames - find broken filenames
I have the problem described in this Q&A. Probably from quite old linux distros or from windows I have several files with broken filenames. ls displays a "?" instead of the broken character. I ...
- 4,014
8
votes
4
answers
10k
views
Chinese encoding in names of compressed files in zip
Sorry for asking a question similar to my previous one. The difference from the last question is that now it is in a zip archive where Chinese encoding in names of compressed files are not recognized,...
- 25.4k
8
votes
2
answers
8k
views
CRON is changing encoding?
I have a legacy Java program that outputs an SQL script. I then use Apache Derby to run that SQL on the target database (which is not on the same server as CRON).
When run via putty, this works fine. ...
- 1,259
6
votes
4
answers
13k
views
Encoding and decoding error in non-English name of compressed file
I have a rar file. After extraction, it generates a file with Chinese name which is shown in Nautilus as:
��������ѧ.������.����������ѧ������.2008.djvu (invalid encoding)
In terminal it is shown as:...
- 25.4k
6
votes
5
answers
20k
views
convert video file to .ogg
I've been having trouble with this because I'm new to Linux:
I would like to convert different video formats to ogv. I found some terminal commands like this: ffmpeg -i input.avi -acodec libvorbis -...
- 10.9k
6
votes
1
answer
2k
views
gedit error : "Unexpected error: Invalid byte sequence in conversion input"
I'm doing a research project in NLP. For that I have to analyze a unicode (Sinhala) text file of around 10mb and it opens in Google docs. But when I try to open it from gedit I'm getting this error
...
- 445
6
votes
2
answers
5k
views
How to convert AC3 6ch audio to HE-AAC? GUI solution?
I want to convert the audio track of a MKV file to HE-AAC (AAC+/AACplus). The audio track is AC3. But there seems no GUI for HE-AAC encoding? I only found out there is a Command Line Tool (CLI) from ...
5
votes
2
answers
4k
views
Can gedit create a Unicode file?
Using bless I can see my gedit output is ASCII. Can gedit process some kind of Unicode?
- 9,771
5
votes
2
answers
10k
views
How enable GPU accelerated video encoders in FFMPEG, Ubuntu 19.04?
How enable HW accelrated encoding in FFMPEG, Ubuntu 19.04 ?
(at least _nvenc variants of h.264/h.265 encoders)
Do you know simplified user friendly way, how to do that using TASKSEL or similar ...
- 1,947
5
votes
2
answers
8k
views
Working with text files encoded as Windows-1250 and UTF-8
I am switching between Ubuntu and Windows frequently therefore I have some encoding problems with text files.
If I save text file in Ubuntu, everything works fine in both systems.
But Ubuntu doesn't ...
- 377
5
votes
3
answers
2k
views
Split ogg-theora video files without re-encoding?
Good evening all,
I have decided to rip my entire DVD collection to Ogg-Theora video, specifically a few different TV series' that I have so I don't have to keep digging the discs out. To do this, ...
- 293
5
votes
1
answer
7k
views
Can't encode in mp3 asunder
When I try to rip CD's from Asunder and automatically encode in mp3, I get the following error:
'lame' was not found in your path. Asunder requires it to create MP3 files. All MP3 functionality is ...
- 4,298
5
votes
1
answer
527
views
How can I find a file's path in the text encoding used by PosteRazor?
PosteRazor uses an apparently outdated GUI that is incapable of properly displaying my filenames:
For the sake of convenience, I want to be able to open any file in PosteRazor by copying and pasting ...
- 77.2k
5
votes
1
answer
5k
views
How can I use Rhythmbox to rip high-quality VBR MP3s
I have a few CDs lying around that I'd like to rip and encode in MP3 format using Rhythmbox. After installing the ubuntu-restricted-extras package, one of the options that shows up in Rhythmbox's ...
- 195
4
votes
4
answers
3k
views
App to create a Video from an MP3 File and GIF Picture(s)?
Is there a an app that allows me to create a Video from an MP3 file (as Audio stream) and one, or more Pictures, such as GIF, PNG, JPG (animated or not)?
So far I've found Pitivi, which appears to do ...
user2817
4
votes
2
answers
2k
views
Is there a way to tell what encoding is used for the name and content of a file?
Is there a way to tell what encoding is used for the name and content of a file? Both GUI and terminal solutions (preferred) are fine. Thanks and regards!
- 25.4k
4
votes
1
answer
2k
views
gedit weird encoding of standard text file
This question wa also posted in this SO post.
I have a standard text file that is shown perfect with cat:
$ cat myfile.txt
v0[shape = Mrecord, label = ""]
When I use xxd to examine the exact line ...
- 103
4
votes
2
answers
2k
views
Play and encode audio in reverse?
Using tools available to Trusty Tahr how can I play audio files in reverse (play them backwards)? I would also like to know of tools that will allow me to save or create such reversed audio files...
- 38.2k
4
votes
1
answer
2k
views
How can I make Banshee re-encode FLAC to Ogg Vorbis when copying to my player?
I have most of my music in FLAC on my large storage device, and would like to automatically re-encode it in Ogg Vorbis when copying it to my portable audio player (Sansa Fuze v2). I have set my Fuze ...
- 1,612
4
votes
1
answer
797
views
How do I discover my current system encoding?
In QtCreator, they have something that looks like this:
I changed the defualt encodring setting in an attempt to get my ide to display emojis, and now my system is really acting up. Including web ...
- 12.1k
4
votes
1
answer
8k
views
How to add Cyrillic in Ubuntu 18.04?
I have already installed Russian keyboard layout.
In language support -> installed languages I already have Russian.
But when I open text file with Cyrillic I have encoding problems. This files was ...
- 295
4
votes
1
answer
1k
views
Ubuntu does not correctly display non-ASCII characters in Windows folder names
If I save folders in windows with special characters like ä/ö/ü or chinese characters, they will be displayed with question marks in Ubuntu. But if I write it directly in Ubuntu, it will be displayed ...
- 151
4
votes
2
answers
4k
views
How to convert a text file with mixture of encodings to a single encoding?
I created a text file by copying its different parts from different
sources (webpages, other text files, pdf files) into gedit and
saving it to the file. I guess that is the reason that I have
...
- 25.4k
4
votes
2
answers
3k
views
Cannot read filenames that are in utf8 encoding (Greek characters)
I've downloaded some files using "Download as .zip" option provided by Dropbox.
The filenames contain Greek characters.
I've extracted them and all I get is this: 2013 ΧειμεÏινÏ.pdf
The files ...
- 1,163
4
votes
1
answer
4k
views
How to set the different default character encoding of `gnome-terminal` from the system default locale?
It seems that the gnome-terminal program use system default local as its default encoding when it is started. For some reason, I can not change the system default locale setting. I want to use another ...
- 253
4
votes
1
answer
1k
views
How can I know the encoding Gedit assumes for a given file?
It appears that there are at least two questions here on Ask Ubuntu that are similar to this, but neither has been answered.
How can I find out the encoding method that gedit uses to open a text file?...
- 95
4
votes
1
answer
7k
views
Replacing LF, NEL line endings in text file with CR+LF
I have a text file with a strange character encoding that I'd like to convert to standard UTF-8. I have managed to get part of the way:
$ file myfile.txt
myfile.txt: Non-ISO extended-ASCII ...
- 2,932
4
votes
0
answers
611
views
How does gedit detect the encoding of a text file? [duplicate]
How does gedit detect the encoding of a text file when opening it?
I notice that gedit can always find the correct encoding when opening a text file of mine, while chardet can often fail to and emacs ...
- 25.4k
3
votes
1
answer
15k
views
Convert string to UTF-8 with terminal only
How I can convert a string to UTF-8 encoding using Ubuntu terminal only?
- 131
3
votes
2
answers
7k
views
How to set default encoding for non UTF encoded documents system wide?
The title says pretty much most of it - I have some windows txt files, and most of them are Bulgarian with encoding windows-1251. When I open them (sublime, gedit, desktop generated icons) the files ...
- 833
3
votes
1
answer
15k
views
Ubuntu display Chinese Characters - Encoding Issue
I'm running a Ubuntu 14.04 32 bit. I'm facing a strange problem displaying Chinese characters in terminal, files, MySQL terminal etc. The Chinese characters are displaying as ?????. After some ...
- 41
3
votes
1
answer
2k
views
Change the encoding of every single .txt file in a folder and its subfolders
I have a folder include many txt files and sub-folders which also contains many txt files.
I want to change all of the files' encoding automatically. Right now I know how to change one file using the ...
3
votes
2
answers
6k
views
Getting file name in hex or base64
Due to a question on Software Recommendations, I thought I could implement a program that parses the output of ls -l and displays the files in an Explorer like style. This approach was suggested on ...
- 4,697
3
votes
2
answers
3k
views
How to edit UTF-8 files with vim
How can I edit UTF-8 files with vim?
There is a problem with german special characters like 'Ä', 'ü'. There are some in the comments. vim shows Ã~D instead of 'Ä' and ü instead of 'ü' then. (I hope ...
- 133
3
votes
1
answer
743
views
Move or resize huge Audacity project files?
My data file directory for a 1 hour mp3 edit file is 1.5 gb. Why is this so big. I only have 12 or so gigs for my system and this wipes me out with 450mb left over. Is there a setting I can change ...
- 1,292
3
votes
2
answers
3k
views
How to detect current gnome-terminal character encoding?
I am trying to detect the current gnome-terminal character encoding from the command line. I have tried using gconftool :
$ gconftool-2 --get /apps/gnome-terminal/profiles/Default/encoding
current
$ ...
- 3,973