Opened 6 years ago

Closed 5 months ago

Last modified 5 months ago

#779 closed defect (fixed)

LM-JM with IDF Factor

Reported by: Sourav Saha Owned by: Olly Betts
Priority: normal Milestone: 1.5.0
Component: Library API Version:
Severity: normal Keywords:
Cc: Blocked By:
Blocking: Operating System: All

Description

Currently, the language model with Jelinek Mercer Smoothing (LM-JM) doesn't have IDF effect involved in it. This ticket is to incorporate IDF in LM-JM equation.

Attachments (1)

p179-zhai.pdf (290.1 KB ) - added by Sourav Saha 6 years ago.

Download all attachments as: .zip

Change History (4)

by Sourav Saha, 6 years ago

Attachment: p179-zhai.pdf added

comment:1 by Olly Betts, 6 months ago

Component: OtherLibrary API
Milestone: 1.5.0
Owner: changed from Sourav Saha to Olly Betts
Status: newassigned

Marking to fix for 1.5.0.

comment:2 by Olly Betts, 5 months ago

Resolution: fixed
Status: assignedclosed

Finally fixed by b97c122cf6f9d06fc8ace542735b0d9e9f18e9bc. Thanks very much for highlighting this issue.

The fix isn't suitable for backporting to 1.4.x so my plan is to just document LMWeight as broken there and recommend not using it.

comment:3 by Olly Betts, 5 months ago

The fix isn't suitable for backporting to 1.4.x so my plan is to just document LMWeight as broken there and recommend not using it.

Done: 904a3d9291c32588f000ea17b18c870bc983dda4

Note: See TracTickets for help on using tickets.