information theory – Calculating Perplexity – Cross Validated

January 22, 2025

In the Coursera NLP course , Dan Jurafsky calculates the following perplexity: Operator(1 in 4) Sales(1 in 4) Technical Support(1 in 4) 30,000 names(1 in 120,000 each) He says the Perplexity is 53…

https://stats.stackexchange.com/questions/103029/calculating-perplexity

information theory – Calculating Perplexity – Cross Validated <body> <h1> Array ( [0] => unformation theory – calculating perplexity – cross validated [1] => jnformation theory – calculating perplexity – cross validated [2] => knformation theory – calculating perplexity – cross validated [3] => onformation theory – calculating perplexity – cross validated [4] => 9nformation theory – calculating perplexity – cross validated [5] => 8nformation theory – calculating perplexity – cross validated [6] => ibformation theory – calculating perplexity – cross validated [7] => imformation theory – calculating perplexity – cross validated [8] => ijformation theory – calculating perplexity – cross validated [9] => ihformation theory – calculating perplexity – cross validated [10] => indormation theory – calculating perplexity – cross validated [11] => incormation theory – calculating perplexity – cross validated [12] => invormation theory – calculating perplexity – cross validated [13] => ingormation theory – calculating perplexity – cross validated [14] => intormation theory – calculating perplexity – cross validated [15] => inrormation theory – calculating perplexity – cross validated [16] => infirmation theory – calculating perplexity – cross validated [17] => infkrmation theory – calculating perplexity – cross validated [18] => inflrmation theory – calculating perplexity – cross validated [19] => infprmation theory – calculating perplexity – cross validated [20] => inf0rmation theory – calculating perplexity – cross validated [21] => inf9rmation theory – calculating perplexity – cross validated [22] => infoemation theory – calculating perplexity – cross validated [23] => infodmation theory – calculating perplexity – cross validated [24] => infofmation theory – calculating perplexity – cross validated [25] => infotmation theory – calculating perplexity – cross validated [26] => info5mation theory – calculating perplexity – cross validated [27] => info4mation theory – calculating perplexity – cross validated [28] => infornation theory – calculating perplexity – cross validated [29] => inforkation theory – calculating perplexity – cross validated [30] => inforjation theory – calculating perplexity – cross validated [31] => informztion theory – calculating perplexity – cross validated [32] => informstion theory – calculating perplexity – cross validated [33] => informwtion theory – calculating perplexity – cross validated [34] => informqtion theory – calculating perplexity – cross validated [35] => informarion theory – calculating perplexity – cross validated [36] => informafion theory – calculating perplexity – cross validated [37] => informagion theory – calculating perplexity – cross validated [38] => informayion theory – calculating perplexity – cross validated [39] => informa6ion theory – calculating perplexity – cross validated [40] => informa5ion theory – calculating perplexity – cross validated [41] => informatuon theory – calculating perplexity – cross validated [42] => informatjon theory – calculating perplexity – cross validated [43] => informatkon theory – calculating perplexity – cross validated [44] => informatoon theory – calculating perplexity – cross validated [45] => informat9on theory – calculating perplexity – cross validated [46] => informat8on theory – calculating perplexity – cross validated [47] => informatiin theory – calculating perplexity – cross validated [48] => informatikn theory – calculating perplexity – cross validated [49] => informatiln theory – calculating perplexity – cross validated [50] => informatipn theory – calculating perplexity – cross validated [51] => informati0n theory – calculating perplexity – cross validated [52] => informati9n theory – calculating perplexity – cross validated [53] => informatiob theory – calculating perplexity – cross validated [54] => informatiom theory – calculating perplexity – cross validated [55] => informatioj theory – calculating perplexity – cross validated [56] => informatioh theory – calculating perplexity – cross validated [57] => information rheory – calculating perplexity – cross validated [58] => information fheory – calculating perplexity – cross validated [59] => information gheory – calculating perplexity – cross validated [60] => information yheory – calculating perplexity – cross validated [61] => information 6heory – calculating perplexity – cross validated [62] => information 5heory – calculating perplexity – cross validated [63] => information tgeory – calculating perplexity – cross validated [64] => information tbeory – calculating perplexity – cross validated [65] => information tneory – calculating perplexity – cross validated [66] => information tjeory – calculating perplexity – cross validated [67] => information tueory – calculating perplexity – cross validated [68] => information tyeory – calculating perplexity – cross validated [69] => information thwory – calculating perplexity – cross validated [70] => information thsory – calculating perplexity – cross validated [71] => information thdory – calculating perplexity – cross validated [72] => information throry – calculating perplexity – cross validated [73] => information th4ory – calculating perplexity – cross validated [74] => information th3ory – calculating perplexity – cross validated [75] => information theiry – calculating perplexity – cross validated [76] => information thekry – calculating perplexity – cross validated [77] => information thelry – calculating perplexity – cross validated [78] => information thepry – calculating perplexity – cross validated [79] => information the0ry – calculating perplexity – cross validated [80] => information the9ry – calculating perplexity – cross validated [81] => information theoey – calculating perplexity – cross validated [82] => information theody – calculating perplexity – cross validated [83] => information theofy – calculating perplexity – cross validated [84] => information theoty – calculating perplexity – cross validated [85] => information theo5y – calculating perplexity – cross validated [86] => information theo4y – calculating perplexity – cross validated [87] => information theort – calculating perplexity – cross validated [88] => information theorg – calculating perplexity – cross validated [89] => information theorh – calculating perplexity – cross validated [90] => information theoru – calculating perplexity – cross validated [91] => information theor7 – calculating perplexity – cross validated [92] => information theor6 – calculating perplexity – cross validated [93] => information theory ᰫ calculating perplexity – cross validated [94] => information theory &#u211; calculating perplexity – cross validated [95] => information theory &#i211; calculating perplexity – cross validated [96] => information theory ⏻ calculating perplexity – cross validated [97] => information theory ᾯ calculating perplexity – cross validated [98] => information theory &#8q11; calculating perplexity – cross validated [99] => information theory &#8w11; calculating perplexity – cross validated [100] => information theory ⁷ calculating perplexity – cross validated [101] => information theory ” calculating perplexity – cross validated [102] => information theory &#82q1; calculating perplexity – cross validated [103] => information theory — calculating perplexity – cross validated [104] => information theory &#821q; calculating perplexity – cross validated [105] => information theory – xalculating perplexity – cross validated [106] => information theory – valculating perplexity – cross validated [107] => information theory – falculating perplexity – cross validated [108] => information theory – dalculating perplexity – cross validated [109] => information theory – czlculating perplexity – cross validated [110] => information theory – cslculating perplexity – cross validated [111] => information theory – cwlculating perplexity – cross validated [112] => information theory – cqlculating perplexity – cross validated [113] => information theory – cakculating perplexity – cross validated [114] => information theory – capculating perplexity – cross validated [115] => information theory – caoculating perplexity – cross validated [116] => information theory – calxulating perplexity – cross validated [117] => information theory – calvulating perplexity – cross validated [118] => information theory – calfulating perplexity – cross validated [119] => information theory – caldulating perplexity – cross validated [120] => information theory – calcylating perplexity – cross validated [121] => information theory – calchlating perplexity – cross validated [122] => information theory – calcjlating perplexity – cross validated [123] => information theory – calcilating perplexity – cross validated [124] => information theory – calc8lating perplexity – cross validated [125] => information theory – calc7lating perplexity – cross validated [126] => information theory – calcukating perplexity – cross validated [127] => information theory – calcupating perplexity – cross validated [128] => information theory – calcuoating perplexity – cross validated [129] => information theory – calculzting perplexity – cross validated [130] => information theory – calculsting perplexity – cross validated [131] => information theory – calculwting perplexity – cross validated [132] => information theory – calculqting perplexity – cross validated [133] => information theory – calcularing perplexity – cross validated [134] => information theory – calculafing perplexity – cross validated [135] => information theory – calculaging perplexity – cross validated [136] => information theory – calculaying perplexity – cross validated [137] => information theory – calcula6ing perplexity – cross validated [138] => information theory – calcula5ing perplexity – cross validated [139] => information theory – calculatung perplexity – cross validated [140] => information theory – calculatjng perplexity – cross validated [141] => information theory – calculatkng perplexity – cross validated [142] => information theory – calculatong perplexity – cross validated [143] => information theory – calculat9ng perplexity – cross validated [144] => information theory – calculat8ng perplexity – cross validated [145] => information theory – calculatibg perplexity – cross validated [146] => information theory – calculatimg perplexity – cross validated [147] => information theory – calculatijg perplexity – cross validated [148] => information theory – calculatihg perplexity – cross validated [149] => information theory – calculatinf perplexity – cross validated [150] => information theory – calculatinv perplexity – cross validated [151] => information theory – calculatinb perplexity – cross validated [152] => information theory – calculatinh perplexity – cross validated [153] => information theory – calculatiny perplexity – cross validated [154] => information theory – calculatint perplexity – cross validated [155] => information theory – calculating oerplexity – cross validated [156] => information theory – calculating lerplexity – cross validated [157] => information theory – calculating -erplexity – cross validated [158] => information theory – calculating 0erplexity – cross validated [159] => information theory – calculating pwrplexity – cross validated [160] => information theory – calculating psrplexity – cross validated [161] => information theory – calculating pdrplexity – cross validated [162] => information theory – calculating prrplexity – cross validated [163] => information theory – calculating p4rplexity – cross validated [164] => information theory – calculating p3rplexity – cross validated [165] => information theory – calculating peeplexity – cross validated [166] => information theory – calculating pedplexity – cross validated [167] => information theory – calculating pefplexity – cross validated [168] => information theory – calculating petplexity – cross validated [169] => information theory – calculating pe5plexity – cross validated [170] => information theory – calculating pe4plexity – cross validated [171] => information theory – calculating perolexity – cross validated [172] => information theory – calculating perllexity – cross validated [173] => information theory – calculating per-lexity – cross validated [174] => information theory – calculating per0lexity – cross validated [175] => information theory – calculating perpkexity – cross validated [176] => information theory – calculating perppexity – cross validated [177] => information theory – calculating perpoexity – cross validated [178] => information theory – calculating perplwxity – cross validated [179] => information theory – calculating perplsxity – cross validated [180] => information theory – calculating perpldxity – cross validated [181] => information theory – calculating perplrxity – cross validated [182] => information theory – calculating perpl4xity – cross validated [183] => information theory – calculating perpl3xity – cross validated [184] => information theory – calculating perplezity – cross validated [185] => information theory – calculating perplecity – cross validated [186] => information theory – calculating perpledity – cross validated [187] => information theory – calculating perplesity – cross validated [188] => information theory – calculating perplexuty – cross validated [189] => information theory – calculating perplexjty – cross validated [190] => information theory – calculating perplexkty – cross validated [191] => information theory – calculating perplexoty – cross validated [192] => information theory – calculating perplex9ty – cross validated [193] => information theory – calculating perplex8ty – cross validated [194] => information theory – calculating perplexiry – cross validated [195] => information theory – calculating perplexify – cross validated [196] => information theory – calculating perplexigy – cross validated [197] => information theory – calculating perplexiyy – cross validated [198] => information theory – calculating perplexi6y – cross validated [199] => information theory – calculating perplexi5y – cross validated [200] => information theory – calculating perplexitt – cross validated [201] => information theory – calculating perplexitg – cross validated [202] => information theory – calculating perplexith – cross validated [203] => information theory – calculating perplexitu – cross validated [204] => information theory – calculating perplexit7 – cross validated [205] => information theory – calculating perplexit6 – cross validated [206] => information theory – calculating perplexity ᰫ cross validated [207] => information theory – calculating perplexity &#u211; cross validated [208] => information theory – calculating perplexity &#i211; cross validated [209] => information theory – calculating perplexity ⏻ cross validated [210] => information theory – calculating perplexity ᾯ cross validated [211] => information theory – calculating perplexity &#8q11; cross validated [212] => information theory – calculating perplexity &#8w11; cross validated [213] => information theory – calculating perplexity ⁷ cross validated [214] => information theory – calculating perplexity ” cross validated [215] => information theory – calculating perplexity &#82q1; cross validated [216] => information theory – calculating perplexity — cross validated [217] => information theory – calculating perplexity &#821q; cross validated [218] => information theory – calculating perplexity – xross validated [219] => information theory – calculating perplexity – vross validated [220] => information theory – calculating perplexity – fross validated [221] => information theory – calculating perplexity – dross validated [222] => information theory – calculating perplexity – ceoss validated [223] => information theory – calculating perplexity – cdoss validated [224] => information theory – calculating perplexity – cfoss validated [225] => information theory – calculating perplexity – ctoss validated [226] => information theory – calculating perplexity – c5oss validated [227] => information theory – calculating perplexity – c4oss validated [228] => information theory – calculating perplexity – criss validated [229] => information theory – calculating perplexity – crkss validated [230] => information theory – calculating perplexity – crlss validated [231] => information theory – calculating perplexity – crpss validated [232] => information theory – calculating perplexity – cr0ss validated [233] => information theory – calculating perplexity – cr9ss validated [234] => information theory – calculating perplexity – croas validated [235] => information theory – calculating perplexity – crozs validated [236] => information theory – calculating perplexity – croxs validated [237] => information theory – calculating perplexity – crods validated [238] => information theory – calculating perplexity – croes validated [239] => information theory – calculating perplexity – crows validated [240] => information theory – calculating perplexity – crosa validated [241] => information theory – calculating perplexity – crosz validated [242] => information theory – calculating perplexity – crosx validated [243] => information theory – calculating perplexity – crosd validated [244] => information theory – calculating perplexity – crose validated [245] => information theory – calculating perplexity – crosw validated [246] => information theory – calculating perplexity – cross calidated [247] => information theory – calculating perplexity – cross balidated [248] => information theory – calculating perplexity – cross galidated [249] => information theory – calculating perplexity – cross falidated [250] => information theory – calculating perplexity – cross vzlidated [251] => information theory – calculating perplexity – cross vslidated [252] => information theory – calculating perplexity – cross vwlidated [253] => information theory – calculating perplexity – cross vqlidated [254] => information theory – calculating perplexity – cross vakidated [255] => information theory – calculating perplexity – cross vapidated [256] => information theory – calculating perplexity – cross vaoidated [257] => information theory – calculating perplexity – cross valudated [258] => information theory – calculating perplexity – cross valjdated [259] => information theory – calculating perplexity – cross valkdated [260] => information theory – calculating perplexity – cross valodated [261] => information theory – calculating perplexity – cross val9dated [262] => information theory – calculating perplexity – cross val8dated [263] => information theory – calculating perplexity – cross valisated [264] => information theory – calculating perplexity – cross valixated [265] => information theory – calculating perplexity – cross valicated [266] => information theory – calculating perplexity – cross valifated [267] => information theory – calculating perplexity – cross valirated [268] => information theory – calculating perplexity – cross valieated [269] => information theory – calculating perplexity – cross validzted [270] => information theory – calculating perplexity – cross validsted [271] => information theory – calculating perplexity – cross validwted [272] => information theory – calculating perplexity – cross validqted [273] => information theory – calculating perplexity – cross validared [274] => information theory – calculating perplexity – cross validafed [275] => information theory – calculating perplexity – cross validaged [276] => information theory – calculating perplexity – cross validayed [277] => information theory – calculating perplexity – cross valida6ed [278] => information theory – calculating perplexity – cross valida5ed [279] => information theory – calculating perplexity – cross validatwd [280] => information theory – calculating perplexity – cross validatsd [281] => information theory – calculating perplexity – cross validatdd [282] => information theory – calculating perplexity – cross validatrd [283] => information theory – calculating perplexity – cross validat4d [284] => information theory – calculating perplexity – cross validat3d [285] => information theory – calculating perplexity – cross validates [286] => information theory – calculating perplexity – cross validatex [287] => information theory – calculating perplexity – cross validatec [288] => information theory – calculating perplexity – cross validatef [289] => information theory – calculating perplexity – cross validater [290] => information theory – calculating perplexity – cross validatee ) </h1> </body>