To enable AES encryption you enter the following in the Encryption Key field

aes:xxxxxxxxxxxx

where xxxxxxxxxxxx is your password.
You must enter the same key in the Tx and Rx Proxy profile's Encryption Key field.

There are three formats for entering DVB-CSA keys in the Encryption Key field. If you enter a 12 character key, the software automatically creates the 16 character key. The 16 character key is used for odd and even keys. For the 32 character key the first 16 characters are for the even key and the second 16 characters are for the odd key. The 12 and 16 character keys may be referred to as BISS keys.

When you enter a correct key format you will see the keys printed in the log. For example if you enter the 12 character key 112233445566 in the Encryption Key field on the Web GUI, you will see the following in the log:

CSAKey (even): 11223366445566ff
CSAKey (odd): 11223366445566ff

For example if you enter the 32 character key 11223366445566FF00221133442266CC, you will see the following in the log:

CSAKey (even): 11223366445566ff
CSAKey (odd): 00221133442266cc

Testing DVB-CSA Encryption with VLC

You can test with VLC by creating a batch script like the following:

set VLC_PROGRAM=%ProgramFiles%\VideoLAN\VLC\vlc.exe
if not exist "%VLC_PROGRAM%" set VLC_PROGRAM=%ProgramFiles% (x86)\VideoLAN\VLC\vlc.exe
start "VLC" "%VLC_PROGRAM%" "rtp://@:10000" ":ts-csa2-ck=11223366445566FF" ":ts-csa-ck=00221133442266CC"

The ts-csa2-ck setting is for the even key and the ts-csa-ck setting is for the odd key. The ts-csa2-ck and ts-csa-ck settings need to match the keys in the Proxy's log.