a
=b$ @ s d dl mZmZmZ d dlmZmZmZ d dlm Z m
Z
m Z d dl m
Z
mZmZ d dlmZmZmZ G dd deZG dd d eZG d
d d eZG d d
d
eZG dd deZG dd deZG dd deZdS ) )EUCTW_CHAR_TO_FREQ_ORDEREUCTW_TABLE_SIZE EUCTW_TYPICAL_DISTRIBUTION_RATIO)EUCKR_CHAR_TO_FREQ_ORDEREUCKR_TABLE_SIZE EUCKR_TYPICAL_DISTRIBUTION_RATIO)GB2312_CHAR_TO_FREQ_ORDERGB2312_TABLE_SIZE!GB2312_TYPICAL_DISTRIBUTION_RATIO)BIG5_CHAR_TO_FREQ_ORDERBIG5_TABLE_SIZE BIG5_TYPICAL_DISTRIBUTION_RATIO)JIS_CHAR_TO_FREQ_ORDERJIS_TABLE_SIZE JIS_TYPICAL_DISTRIBUTION_RATIOc @ sL e Zd ZdZdZdZdZdd Zdd Zd d
Z d d Z
d
d Z dd Z dS )CharDistributionAnalysisi gGz?g{Gz? c C s0 d | _ d | _d | _d | _d | _d | _| d S N)_char_to_freq_order _table_sizetypical_distribution_ratio_done _total_chars _freq_charsresetself r |d |d }}|dkr6|dkr6d|d | d S dS d S )Nr r r> r8 r7 r" r r r. r: second_charr r r r# s z$GB2312DistributionAnalysis.get_orderr; r r r4 r r? s r? c s$ e Zd Z fddZdd Z ZS )Big5DistributionAnalysisc s$ t t| t| _t| _t| _d S r ) r3 rB r r r r r r
r r r4 r r r s z!Big5DistributionAnalysis.__init__c C sX |d |d }}|dkrP|dkr:d|d | d d S d|d | d S ndS d S ) Nr r r8 ? @ r" r r@ r r r r# s z"Big5DistributionAnalysis.get_orderr; r r r4 r rB s rB c s$ e Zd Z fddZdd Z ZS )SJISDistributionAnalysisc s$ t t| t| _t| _t| _d S r ) r3 rG r r r r r r r r r4 r r r s z!SJISDistributionAnalysis.__init__c C sr |d |d }}|dkr0|dkr0d|d }n&|dkrR|dkrRd|d d }nd S || d
}|d krnd }|S ) Nr r r" rF r )r r. r: rA r% r r r r# s z"SJISDistributionAnalysis.get_orderr; r r r4 r rG s rG c s$ e Zd Z fddZdd Z ZS )EUCJPDistributionAnalysisc s$ t t| t| _t| _t| _d S r ) r3 rO r r r r r r r r r4 r r r s z"EUCJPDistributionAnalysis.__init__c C s0 |d }|dkr(d|d |d d S dS d S )Nr r7 r8 r r" r )r r. r$ r r r r# s z#EUCJPDistributionAnalysis.get_orderr; r r r4 r rO s rO N) Z euctwfreqr r r Z euckrfreqr r r Z
gb2312freqr r r
Zbig5freqr r r
Zjisfreqr r r objectr r2 r= r? rB rG rO r r r r