GitHub - Cadlaxa/Syllable-Based-ARPAsing-Phonemizer: A custom English Arpabet Phonemizer for OpenUtau with vowel and consonant fallbacks and consonant timings. (original) (raw)

When downloaded, move ArpaPlusPhonemizer.dll into the path\to\OpenUtau\Plugins folder or just simply drag the dll file and drop onto the OpenUtau program.

As of OpenUtau v0.1.421.0 (beta), Arpasing+ Phonemizer has been merged to main and everyone who has the dll file of the external phonemizer can now delete it to avoid duplication of the phonemizer.

Custom English Arpabet Phonemizer based on Syllable-Based API Phonemizer

As of version V0.0.55 and above, it now supports the majority of all ARPAsing voicebanks, also V0.0.55 and above is much more stable than the previous versions of this external Phonemizer.

📍 if you want to suggest a feature for ARPA+, you can suggest on the issues tab or the discussions tab

📍 if there's any issue with the Phonemizer, you can contact me through my Twitter. Let me know if there's a problem tehee.

Table of contents

• How to download and install the custom Phonemizer
• Supported Consonants and Vowels
• Mechanics of the Phonemizer
  • How syllables work
  • Vowel and Consonant Fallbacks
  • Phonemizer Demo

How to download and install the custom Phonemizer

• To download and install the Phonemizer, click on Releases then click the dll file to download. When downloaded, move ArpaPlusPhonemizer.dll into the path\to\OpenUtau\Plugins folder or just simply drag the dll file and drop onto the OpenUtau program.

image by Astel for visual representation

Supported Consonants and Vowels

• Consonants are automatically supported by this phonemizer but if the consonants aren't listed on the GetTransitionBasicLengthMs, their lengths are defaulted to 1.0 ms
• Currently supported vowels:
  • aa, ax, ae, ah, ao, aw, ay, eh, er, ey, ih, iy, ow, oy, uh, uw, a, e, i, o, u, ai, ei, oi, au, ou, ix, ux,aar, ar, axr, aer, ahr, aor, or, awr, aur, ayr, air, ehr, eyr, eir, ihr, iyr, ir, owr, our, oyr, oir, uhr, uwr, ur,aal, al, axl, ael, ahl, aol, ol, awl, aul, ayl, ail, ehl, el, eyl, eil, ihl, iyl, il, owl, oul, oyl, oil, uhl, uwl, ul,naan, an, axn, aen, ahn, aon, on, awn, aun, ayn, ain, ehn, en, eyn, ein, ihn, iyn, in, own, oun, oyn, oin, uhn, uwn, un,aang, ang, axng, aeng, ahng, aong, ong, awng, aung, ayng, aing, ehng, eng, eyng, eing, ihng, iyng, ing, owng, oung, oyng, oing, uhng, uwng, ung, aam, am, axm, aem, ahm, aom, om, awm, aum, aym, aim, ehm, em, eym, eim, ihm, iym, im, owm, oum, oym, oim, uhm, uwm, um, oh, eu, oe, yw, yx, wx, ox, ex
  • 📍 note: if the custom vowels are not here on the list or in the code, they will be recognized as consonants, Syllable-based Phonemizers will have to define all possible vowels in order to them to be recognized as a Vowel

Mechanics of the Phonemizer

How syllables work

• Syllables are built like:
  • Starting C: [- c]
  • Starting CV: [- c v] or [- cv]
  • Starting CCV: [- ccv] or [- cc v]
  • Starting V: [- v] or [v]
  • VV: (Fallbacks to [v c][c v]/[cv] then [c v]/[cv] then [v], if vb doesn't have [v], glottal stop are used instead)
  • Connecting CV: [c v] (Fallbacks to [cv]if no alias is detected)
  • Connecting CCV: [ccv] or [cc v]
  • Connecting VC: [v c] then [v -] [- c
  • Connecting CC: [c c] (with consonant fallbacks) then [c1 -] [- c2]
  • Connecting CCC: [c cc] (fallbacks to [c c])
  • Ending C: [c -]
  • Ending V: [v -]
• Phoneme length are specified directly to the phonemizer:
  • Default transition in ms: '1.0'
  • Vowels: 'default'
  • Consonants: '1.3'
  • Affricates: '1.5'
  • Long Consonants: '2.3'
  • Semi-long Consonants: '1.3'
  • Tap Consonant: '0.5'
  • Glide Consonants: '2.5'

Vowel and Consonant Fallbacks

• This custom Phonemizer supports vowel and consonant fallbacks:
  • CV/CCV Fallback: [cc v] or [ccv] and [c v] or [cv]
  • VV Fallback: `([v c][c v]/[cv] then [c v]/[cv] then [v], if vb doesn't have [v], glottal stop are used instead)``
  • Connecting VC/VCC Fallback: [v c] then [v -] [- c]
  • Connecting CC/CCC: [c c] (with consonant fallbacks) then [c1 -] [- c2]
  • Starting and Ending Consonants

Phonemizer Demo

• Consonant Timing Difference
  • Vocal: Arpa_test
  • EN ARPA: consonant timings are constant to 0.5 ms arpa.default.mp4
• EN ARPA+: consonant timings changes depending on the consonant arpa.plus.mp4
• English
  • Vocal: KYE ARPAsing
  • EN ARPA:
    do.you.like.my.voice_KYE.arpa.mp4
  • EN ARPA+:
    do.you.like.my.voice_kye_en_arpa+.mp4
• Chinese (with dictionary)
  • Vocal: LIEE ENGLISH by @utauraptor
  • EN ARPA:
    ye.hua_liee.arpa_01.mp4
  • EN ARPA+:
    ye.hua_liee.arpa+_00.mp4
• Japanese (with dictionary)
  • Vocal: Ryujin Soru by @Sora/Rippa
  • EN ARPA:
    akatonbo_ryujin.en.arpa.mp4
  • EN ARPA+:
    akatonbo_ryujin.arp+a.mp4