o !jM@sdZddlZddlmZddlmZedZgdZgdZgdZ e d Z d e d e fd d Zd e d e fddZd e d e fddZd e d efddZde d e d ee e ffddZdde d efddZdS)ux symbol_filters.py Shared filtering rules used by BOTH scanners (premarket_scanner.py's universe pull, and top_stocks.py's replacement search) so a symbol that's excluded in the morning can't sneak back in as a same-day replacement candidate. Three filter categories, all configurable via config.json -> universe: 1. ETFs / funds / trusts / notes (exclude_etfs_and_funds) 2. Leveraged / inverse ("multiplier") products, e.g. 2x/3x bull/bear, ultra, daily-target products (exclude_leveraged_inverse) 3. Company names that are too syllable-heavy to be a clean, liquid, easily-recognized single-purpose equity ticker (max_name_syllables) Alpaca's Asset objects (asset_class=US_EQUITY) include ETFs and ETNs — US_EQUITY alone does NOT separate common stock from funds. Filtering must be done on the asset's `name` field since there's no clean is_etf boolean on the SDK object. N) get_config) get_loggersymbol_filters)etfetntrustz fundz index fundz index trust prosharesdirexionisharesspdrvaneckinvescozglobal x wisdomtreezark vanguard granitesharesz simplify z defiance roundhilltuttleyieldmaxzexchange tradedzunit investment trustzdepositary sharesz notes duezexchange-traded)2x3xz-1xultra ultrashortz ultra shortzbull zbear leveragedinversez daily targetz daily bullz daily bearz 3x sharesz 2x sharesdoubletriple)z \binc\.?\bz\bincorporated\bz \bcorp\.?\bz\bcorporation\bz \bco\.?\bz \bcompany\bz \bltd\.?\bz \blimited\bz \bholdings?\bz \bgroup\bz\bplc\bz\bllc\bz \bl\.p\.?\bz \bclass a\bz \bclass b\bz \bclass c\bz\bordinary shares?\bz\bcommon stock\bz\bsa\bz\bag\bz\bnv\bz [aeiouy]+namereturnc&|sdS|tfddtDS)NFc3|]}|vVqdSN.0kwnr!)/var/www/screener/trade/symbol_filters.py <z!is_etf_or_fund..)lowerany_FUND_KEYWORDSrr!r%r'is_etf_or_fund8r.cr)NFc3rr r!r"r%r!r'r(Cr)z*is_leveraged_or_inverse..)r*r+_LEVERAGED_INVERSE_KEYWORDSr-r!r%r'is_leveraged_or_inverse?r/r1cCs$|}tD] }t|d|}q|S)N )r*_LEGAL_SUFFIXESresub)rr&patternr!r!r'_strip_legal_suffixesFsr7cCsz|sdSt|}td|}d}|D](}|}t|}t|}|dr3|ds3|dkr3|d8}|t|d7}q|S)ua Rough English syllable-count heuristic: strips legal suffixes (Inc, Corp, Class A, etc. shouldn't count against the company's "real" name), then counts vowel-groups per word, with a silent trailing-e correction. Good enough to flag genuinely long, multi-syllable company names — not intended to be linguistically perfect. rz [a-zA-Z]+ele)r7r4findallr* _VOWEL_GROUPSlenendswithmax)rcleanedwordstotalwordwgroupscountr!r!r'count_syllablesMs   rGsymbolcCsrtd}|ddrt|rdS|ddrt|rdS|d}|r7t|}||kr7dd |d |d fSd S) zr Returns (passes, reason_if_rejected). Applies all three configured filters. Called by both scanners. universeexclude_etfs_and_fundsT)FzETF/fund/trustexclude_leveraged_inverse)Fz&leveraged/inverse (multiplier) productmax_name_syllablesFzname too complex (z syllables > ))T)rgetr.r1rG)rHrcfg max_syllablessylr!r!r'passes_symbol_filterses  rSTlog_rejectionscCslg}|D]/}t|dd}t|ddpd}|sqt||\}}|r&||q|r3td|d|q|S)z assets: iterable of Alpaca Asset objects (must have .symbol and .name) Returns the list of symbols that pass all filters. rHNrrNz [FILTER] z rejected: )getattrrSappendlogdebug)assetsrT survivorsarHrokreasonr!r!r'filter_symbol_list{s  r^)T)__doc__r4 config_loaderr logger_setuprrWr,r0r3compiler<strboolr.r1r7intrGtuplerSlistr^r!r!r!r's