Not sure what SVG is, but I have an approach that you can consider.
Many years ago when I was a year 6 student, most games are using DOS, so displaying characters became an issue, especially for those languages have a lot of characters, such like Chinese. The most popular approach at that time, is to use pixel-font. A data file contains all pixel information of 65000+ Chinese characters is around 200KB.
For example, a character like 'F' may have the following pixel data:
0 0 0 0 0 0 0 0
0 1 1 1 1 1 0 0
0 1 0 0 0 0 0 0
0 1 0 0 0 0 0 0
0 1 1 1 1 0 0 0
0 1 0 0 0 0 0 0
0 1 0 0 0 0 0 0
0 1 0 0 0 0 0 0
when you are drawing pixels, only draw 1s, ignore 0s.
convert it to bytes:
0x00
0x7C
0x40
0x40
0x78
0x40
0x40
0x40
that is, 8 bytes for a character, for a language has 1000 characters, it's 8000 bytes(< 8KB) and when it is stored in a jar file, it is compressed to less.
Also, it's not common for a MIDlet to run on a handset that does not support it's characters, many phones have several languages support, I mean, even if the phone cannot input characters in that language, the phone may be able to display characters in the language.
I just finished an MIDlet, it support both English and Chinese, it works nicely on my 6230 phone(ie my phone can display Chinese), although my phone cannot input Chinese.
my midlet:
http://www.olnex.net/prj/bluebuddy/bb_en.html