Typology for Linguistic Pattern in English-Hindi Journalistic Text Reuse

Published Online August 2016 in MECS

Newspapers report events that are taking place in any part of the world at more or less same time across different languages. Any news conveys same facts across language but news reporters try to incorporate their viewpoints according to their findings. Linking news stories covering the same events and with same content written in different languages may provide rich and valuable multilingual resources of both parallel and comparable text. Translation equivalents provides parallel fragments and paraphrases provides comparable fragments [2]. Guan and Yuan [29], while working with mislabeled data, have also emphasized on the importance of pattern classification in machine learning. In case of Indian languages there exist limited language resources for Natural Language Processing (NLP) and Information Retrieval (IR) tasks and identifying comparable and parallel documents would offer a potential source for deriving bilingual dictionaries and training statistical Machine Translation (MT) systems [2, 19]. Paraphrasing is the most common way of reproducing news stories. In paraphrasing, substitution for semantic equivalents and grammar, are performed over the text which make even similar contents difficult to identify. Although, linguistic transformations take place in the paraphrased sentence but meaning is still preserved. Translated text in a different language is also a type of special kind of paraphrasing [4]. In order to determine what paraphrasing types make text reuse detection harder to be revealed, analysis, identification and classification of the different types of paraphrasing strategies applied during the text re-use process is important. Typology is nothing but drawing boundaries among different paraphrase types, identifying their manifestations, going into depth to find their characterization and finally classifying them [4]. Building a Typology has been a tool for many NLP researchers to apprehend paraphrasing [24].

Knowledge of paraphrase typology will help in identifying and linking similar news stories by applying suitable techniques. It is also an important aspect in IR research which also deals with document representation languages and models, and finding similar matching contents from documents collections on the web [30]. Therefore in this paper paraphrases are identified across English-Hindi language and a Typology for English-Hindi journalist text reuse has been proposed. It is a pioneer work in context with English-Hindi journalist text reuse and unravels level of difficulties in English-Hindi mapping. The proposed typology has been built by considering other monolingual typologies given by different authors and comprises of previously defined categories in addition to many new categories to encompass the unique cases of English-Hindi crosslingual journalistic reuse. The existing typologies have either been mapped in context to English Hindi language or are modified according to the intrinsic representation of the transformation across these two languages. The proposed typology may help in devising techniques for linking similar paraphrased contents in in English Hindi document pairs.

The rest of the paper is structured as follows: In Section II various monolingual typologies given by different authors are discussed. In Section III proposed paraphrase typology for English-Hindi journalistic text reuse is discussed. Section IV presents discussion on the typology classes in context to empirical evidence and Section V presents the conclusion.

• II.    C hronological R elated W ork

  Early works on paraphrase typologies are by Culicover [9] in1968 and Honeck [17] in 1971. They divided paraphrase types into those classes which can either be formally mapped in natural language processing or cannot be.

Culicover [9] logically grouped paraphrasing into five types and separated accessible paraphrase relationships from inaccessible ones.

A taxonomy in the fields of Psychology was given by Honeck [17] which classified three types of paraphrases including transformational, lexical and formalexic.

As reported by Vila et al.[23] in 2011 Apresjan (1973) mainly dealt with lexical paraphrases and Martin (1976) focused mainly on connotation, opposition and synonymy based paraphrases.

An editing taxonomy has been given by Faigley & Witte [15] in 1981 which divides revisions into two major categories; surface changes and meaning changes, each of which have 2 subcategories finally culminating into 23 types at the lowest level.

Dras [13] in 1999 studied syntactic paraphrases using Synchronous Tree Adjoining Grammars and classified paraphrasing types into classes based either on the formal change observed in the paraphrase pair or according to the paraphrase effect which makes them not mutually exclusive. The five classes of paraphrase that he identified are Change of Perspective, Change of Emphasis, Change of Relation, Deletion, and Clause Movement which are further divided into 51 sub-types.

Barzilay et al. [5] in 1999, Dolan et al. [11] in 2004 and Dutrey et al. [14] in 2011 gave an NLP typology of the most frequent types in a corpus whereas Kozlowski et al. [18] in 2003, Dorr et al. [12] in 2004 and Boonthum [7] in 2004 concentrated on the paraphrases that NLP addresses. Rinaldi et al. [21] in 2003 focused on classic paraphrases with illustrative purposes.

• 16 obfuscation types were reported by Clough [8] in 2003 in his paraphrase typology which dealt with text reuse.

Conversives, non-literal language use and extended paraphrases were studied by Dorr et al. [12] in 2004 while dealing with paraphrases with equivalent meanings. He focused on the syntax, lexicon, and grammatical features of the paraphrases.

Based on the type of linguistic units or the range of difference between the original and paraphrased sentences Shimohata [22] in 2004 has classified the paraphrase into three types only-Sentential, Phrasal and Lexical. Each paraphrasing type requires a different kind of knowledge to deal with. Sentential paraphrasing requires pragmatic knowledge, phrasal paraphrasing requires syntactic knowledge, and lexical paraphrasing requires lexical knowledge

Fujita [16] in 2005 analyzed a variety of linguistic phenomena in Japanese and provided a more detailed classification of paraphrases than in Shimohata [22]. He classified them on the basis of their similarities and differences in syntactic characteristics. He presented a classification of lexical and structural paraphrases grouped into six classes including paraphrases of single content words, function-expressional paraphrases, paraphrases of compound expressions, clause-structural paraphrases, multi-clausal paraphrases, and paraphrases of idiosyncratic expressions. These where further subdivided into 24 types.

Barreiro [3] in 2008 divided paraphrases into 5 classes- referential, lexical, phrasal, syntactic, lexical-syntactic and paraphrasing of multiword expression. The typology is based on the extent of paraphrasing within a sentence ranging from a single lexicon to a phrase to more than one phrase or more than one level of paraphrasing.

Clough and Gaizauskas [25] in 2009 studied journalistic text reuse and gathered three recurrently applied operations which are analogous to some entries of their typology: deletion, lexical substitution, changes in syntax and summarization.

A general typology of quasi-paraphrases together with their relative frequencies has been given by Bhagat [6] in 2009. The basis of classification of paraphrases is lexical and each of the types of paraphrase is linked to the compositional alterations involved.

Marta Vila et al. [23] in 2011 hypothesize that there exists a correlation between the differences in propositional content and the differences in wording on the one hand, and the degree of sameness of meaning or paraphrasability on the other, both being gradual properties. The typology they have presented classifies paraphrases according to the linguistic nature of their difference in wording and consists of a two-level typology of 2 paraphrasing types grouped into 5 classes. Paraphrasing types reflect a general paraphrase mechanism and classes represent the level of language where this mechanism takes place.

The paraphrase typology given by Barron et al. [4] in

2012 relies on the paraphrase concept defined by Recasens and Vila [20] in 2010 and Vila et al. [23] in 2011. It consists of an upgraded version of the one presented in the latter. Their typology also consists of a two-level typology but of 20 paraphrase types instead of 9 there grouped into six classes instead of 5.

Marta Vila et al. [24] in 2014 in their recent work refined their former typology and have given a new three level typology of 24 paraphrase types grouped in 5

classes.

The paraphrase typologies and their basis are compiled in Fig. 1a and Fig. 1b.

Although some work has been done towards finding text reuse or linking news stories in English-Hindi but as per the knowledge of the authors, no paraphrase typology for these two language pairs has been reported so far. Also, the work done in these two language pair is directly proportional to the tasks defined by FIRE since 2009.

Author	Year	Basis of Typology	Types
Culicover	1968	Linguistically founded and logical grouping- separated accessible paraph rases from inaccessible ones	5 types-transformational, attenuated, lexical, morphological/derivational, and real-world
Honeck	1971	Typology in context of Psychology	3 types-transformational, lexical and formalexic(combination of the two)
Faigley St Witte	1981	Revision/editing taxonomy	2 categories- surface changes and meaning changes-finally culminating into 23 types
	1999	Syntactic paraphrases- classification based on change of order or change of	5 classes- change of perspective, emphasis, relation, deletion and clause movement and 51 sub types
Shimohata(Japanese)	2004	Paraphrase Types based on knowledge required to deal with it	3 types-sentential requiring pragmatic knowledge, phrasal requiring syntactic knowledge and lexical requiring lexical knowledge
Fujita(Japanese)	2005	Based on Linguistic Pheneomenaclassification on basis of similarities and differences in syntactic categories	6 classes-paraphrases of single content words, function-expressional paraphrases, paraphrases of compound expressions, clause-structural paraphrases, multi-clausal paraphrases, and paraphrases of idiosyncratic expressions. These where further subdivided into 24 types
Barreiro	2008	Typology based on extent of paraphrasing within a sentence	5 classes-referential, lexical, phrasal, syntactic, lexical-syntactic

Fig.1a. Paraphrase Typologies

Author	Year	Basis of Typology	Types
Clough and Gaizauskas	2009	Studied journalistic text reuse and gathered four recurrently applied operations forming basis of their typology	Deletion (of redundant context and resulting from syntactic changes), lexical substitution (synonymous and phrases), changes in syntax (word order, tense passive and active voice switching) and summarization
Bhagat	2009	Basis of classification of paraphrases is lexical (e.g., actor/action substitution or noun/adjective conversion) and has linked each of these types to the compositional alterations involved (substitution, addition/deletion and/or permutation).	Their approach restrains the possible compositional alterations to only three
Recasens and Vila	2010	Classifies paraphrases according to the linguistic nature of their difference in wording	Two-level typology of 9 paraphrasing types grouped into 5 classes
Barron et al	2011	It consists of an upgraded version of the one presented in Recasens and Vila 2010	Two-level typology but of 20 paraphrase types instead of 9 there grouped into six classes instead of 5
Marta Vila, M. Antonia Marti, Horacio Rodriguez	2014	Refined their former typology given in 2010-a comprehensive typology of paraphrasing that focuses on general paraphrase phenomena, leaving finegrained linguistic mechanisms in a second term. It also has a hierarchical structure	New three level typology of 24 paraphrase types grouped in 5 classes, two of them having two sub-classes each

Fig.1b. Paraphrase Typologies

English and Hindi languages not only differ in scripts but also in their grammar and vocabulary. English stores the meaning of the words in positions whereas Hindi, in morphemes. Identifying equivalent translated text across language becomes a challenging task as this category of text can be treated as obfuscation as well as paraphrasing. Identifying parallel contents in cross language news becomes even more complex if too much of alternation has been done to the translated news stories.

• III.    P roposed T ypology

Although a pioneer work in the field of English-Hindi language text reuse, the typology has been built by considering other monolingual typologies covered in the related work section. It aims to cover most of the phenomena described in these typologies. As the works of other authors, referred in this research paper, are primarily based on monolingual paraphrasing, therefore some classes that are not finding relevance across the language are dropped here. In the proposed typology, apart from inclusion of some of the previously defined categories, some new categories are introduced by us to signify their importance for cross language text reuse. The previously defined categories are followed by citations of the authors who have proposed them. Categories without any citation are the new categories proposed by us.

The typology is strictly formulated for cross lingual news stories covering English-Hindi language. Cross Language Indian News Story Search (CLINSS) corpus1 of FIRE 2012 and 2013 with 50691 files, English newspaper Hindustan Times and Hindi newspaper Dainik Bhaskar has been used as the corpus for the study and for inferring a typology for cross language news story. The parallel stories have been extracted from these newspapers manually and have been retrieved from CLINSS corpus using relevance judgment file provided by them. Text alignment was done manually by the authors themselves. The categories are classified to be in isolation but some of them overlap i.e. two classes can co-exist. For example, if there is a sentence split, there is addition of words also. Any paraphrased parallel sentence in majority of the reported news is a combination of more than one such category. Still, while discussing any particular category of typology, only that category of paraphrasing is emphasized at that point.

The classification has been done on the basis of extent of words in the sentences which are paraphrased and on the basis of difficulty in automatic identification of cross lingual news stories. Five difficulty levels have been identified and each level describes the extent of paraphrasing.

The Hindi words/phrases/sentences which have been used as examples under each level also have their transliterated English versions following them, within brackets, for the ease of understanding by those who are not the native speakers of Hindi language.

As the following examples have been taken from original news stories, some names have been changed/hidden wherever found necessary, in view of keeping work purely for the purpose of research and not to hurt any sentiments.

• A. Level I

News stories that are almost exact translations of their English counterpart fall under this category. 1(b) and 2(b) are nearly exact Hindi translation of 1(a) and 2(a). In such cases simple dictionary based cross language approach may be fruitful to retrieve same news story for text reuse

• 1    a). Palson owner convicted in attempt-to-murder case 1 b). ?W Фт ФИ^^ Фя ЯЧМЯИ ФянГЙФ з№

( hatya ki koshish mein palson ke maalik doshi )

• 2    a). We wanted to know where all were the camps, who were in charge.

• 2    b). ЧЯ diddi ЯТЧН У1Ф Фч ^^Т - ^^Т ЯЧТЧ яч У ^ТЗЧФ1 $^|j Ф!ч УТI

( hum janana chahte the ki camp kahan kahan lagaye gaye the aur unka incharge kaun tha )

• B.    Level II

In this level key content words in Hindi are unambiguously mapped from E 1 to H 1 set but sentences may have a few additions/deletions of words or trivial modifications in one language or other. Linking Cross language news stories needs to map these words. Gist or meaning in this level is preserved. Categories identified under this level have also been reported in monolingual text reuse.

• B.1.    Word Insertion/Deletion

  New information is added to a sentence by adding or deleting words [4, 23], leading to a paraphrase at the time of cross language text reuse (3(a) & 3(b) and 4(a) & 4(b)). It may have minor syntactic transformation or lexical replacement. Robin [26] in 1994 introduced the term ‘Information adding’ paraphrases for such type of paraphrase.

• 3 a). The base price of $225-million remains the same.

• 3 b). З^'Ч ФЧТ f3 ^тя! ФТ ^Я ЧТ^Я 22.5 ФГГЧ ЧТЯТ цт^г фГтч 10 ^ГЧ 5ЧЦ ^т Г^^Т

• ( unhone kaha ki teamon ka base price 22.5 karod dollar yani kareeb 10 arab rupye hi rahega )

• 4 a). This has remained secret until now.

• 4 b). d^dlj^j Ф 5Я НТЧ Ч^Ч ЦТ ^Я ЧТ ^т4 ФТ ГТ^ ЭТЯ НФ ЧЧТ Ч^ УТ!

( dastavejon ke is tarah nasht ya gum ho jaane ka raaj aaj tak bana hua tha )

In 3(b) and 4(b) underlined lexical units are added but same information of 3 (a) and 4 (a) is communicated. In 3 (b) few lexical units are transliterated instead of translation such as “ base price” is transliterated as “ ^H

Ш^Н".

In case of deletion of lexical unit normally words in a sentence that are superfluous or peripheral in sentence are removed. The constituents deleted are: hedging verbs, relative pronouns etc. [13]. In 5 (b) “ will completely” and “ from circulation” are removed while translating 5 (a). This may be done to shorten the news stories.

• 5 a). {..} will completely withdraw from circulation {..}

• 5 b). {..} ЩЧ3ЙШ

( {..} wapas lega )

• B.2.    Sentence Split/Join

The information may be spread over more than one sentence or may be combined in single sentence. These types of paraphrases have two components text units and connective between clauses which is normally altered [13]. The sentence in 6 (a) has been split and translated into two sentences in Hindi 6 (b).

• 6  a). Ramesh, 50, who was serving his life

imprisonment, is survived by his wife and two children Rakesh and Karuna both of whom are college students.

• 6    b). тйу ^ чТГзк Я зз£г ч?Н ^r st з^У ттйкг нкт ^ят K stHr^T^^ ^ f^^^T^f Ki

( Ramesh ke parivar mein uski patni aur do bachche rakesh tatha karuna hain. Dono college ke vidyarthi hain )

• B.3.    Change in Modality

7 a). He won’t be able to make {..} into {..}

• 7    b). зз^Г Ki3y H hK {..} ^T {..} знтН ^T

( unki haisiyat nahin{..} ko {..} banana ki )

• 8    a). The meaning of {..} is 24 hours electricity

• 8    b). УТУН K {..} уутН ^T ЯН^З ? {..} уутН ^т ЯН^З KtHTK 24 Ut f^^^T .

(jante hain {..} banane ka matlab? {..} banana ka matlab hota hai 24 ghante bijli)

• B.4.      Passive vs. Active/Direct-Indirect Style

Alteration/Voice Alternation/Change of Emphasis [4, 13, 23, 24]

9 a). Water released from the dam completely submerged the fields

9 b). ^ТУ З^тГтчт^гЙ^нчГ H4F ^^й^Н

( baandh se jaari paani mein khet poori tarah jalmagn )

• 10    a). "Of course I am disappointed. But it was the decision of the governing council," he said

• 10    b). ^^Ч|йы ^1й?нг Н"щ^ й^^т f^ fer т^ ^ГНг З'^тлт^ 3F 1Нтт^ ^ ^f^y ук зз1Нз| Ф1з13^ ^т ^>з^т Ki

( IPL commissioner ne baad mein kaha ki tender radd hone se halanki who nirash hain lekin yeh governing council ka faisla hai )

• B.5.    Representational Change

Many times category of noun may be changed at the time of translation. In 12 (b) natives are represented by country at the time of translation from 12 (a).

• 11    a). Indians showed great restraint after the last {..} attack

• 11    b). f4B^ ’ {..} кя^ ^зк яттн Н^^^кн УУ ^т ч!Г^у f^yr

( pichhle {..} hamle ke baad bharat ne jabardast dhairya ka parichay diya )

C. Level III

In this level, normally translated sentence contains few content lexical units that are not proper translation across the language. Linking such news stories is a challenging task as news stories communicate same information but words may not have direct mapping. Such cases may fall under the category of low obfuscation or lexical paraphrasing.

C.1. Localization Related Issues

In this class cross language text reuse is dominated by localization related issues. It is observed that such types of usages are among the most common ones in new story text reuse. [23] has considered this class as a case of change of format. Date (12 (a)) currency (12 (b) and 12 (c)) are the most common examples of this class (Table 1). Date can be written in any applicable format in English and gives rise to many permutations and combinations of Hindi translations formats. Likewise in natural language, currency can be expressed in users own ways and may not always conform to the dictionary equivalents. Like in 12 (b) “ten million” is translated in Hindi as “W ^ГЛ” which is wrong, and not as “УФ ф.й” when given to a Machine Translation system. But a person can intrerpret it as “УФ ФГГФ or as transliterated version of its English counterpart.

Many such examples are present in FIRE corpus.

Some of the examples are shown in Table 1

Table 1. Localization related issues in English-Hindi Cross Language Text Reuse

Example No.	English	Hindi(which is not translated by MT system)
8 a)	June 12, 2009	^RS ^й 2009 ( barah june 2009 )
8 b)	$10 million	чф ф /10 fHPm Sid. ( ek karod dollar/10 million dollar )
8 c)	$5 million	50       d№ Sid. ( 50 lakh dollar )

C.2. Partial Improper Translation

In this class linguistically the situation is communicated as per the syntax of the respective language but if one tries to map the text reuse then few lexical units may not map due to partial improper translation (13 (a) & 13 (b) and 14 (a) & 14 (b)). “Crashed on him” will never map to “ сфчт ЙЧ $ ” and “amended” does not mean “фс1Л”.

• 13    a). {..} door crashed on him

• 13    b). £ ^<^l^ £ ФФТ ЙЧ fr

( ve darwaze se takra gaye the )

• 14    a). {..} Can be amended .

• 14    b). {..} фс!Л St £фЛ S

( katauti ho sakti hai )

Automatic mapping for text reuse under this class is quite challenging. In 15(a) “ boy” the actor is referred as “ cfd ” in 15(b) which is not proper. Table 2 shows some of the words present in the new stories that shall never mapped properly.

• 15 a).  {..}an affair with a boy from a different

community

• 15    b). {..} ТФЛ Лт f^rr^Tr Ф с^ГФл £ йн {..}

( {..} kisi aur biradari ke vyakti se prem{..} )

Table 2. Partial Improper Translation

English word	Hindi word found in News Articles	Exact dictionary mapping in Hindi
Boy	c^Rd ( vyakti )	я^Ф ( ladke )
Girl	Hf$dl ( mahila )	я^ФГ ( ladki )
Ordered	h>£dl    MM ( faisla sunaya )	ыфт fS^r ( aadesh diya )
Police	Лн ( team )	Ч1Й£ ( pulis )
Bill	ФТгт ( kota )	М^Ф ( vidheyak )
Calculation	£Н1Ф<И ( samikaran )	^^^r ( ganana )
Chief	ф!Н^ж ( commisioner )	4H^ / H^^ ( pramukh/mukhya )
Chairman	ф!Н^ж ( commisioner )	^t^^ ( adhyaksh )

C.3. OOV words substitutions

Socio-cultural influence across globe results in acceptability of some of the lexical units that are normally treated as Out of Vocabulary (OOV) for native language. In such cases although the Hindi equivalents of the words are available, but instead of taking exact word translations, transliterated words are accepted at the time of news reporting because such transliterated versions are more in use than the translation equivalents. Hindi has adopted many such words in its day to day writings and conversations but such words do not find any place in the dictionary as Hindi meanings of English words. These words also create problems if we go for Dictionary based approaches for mapping these words. Some of the words of FIRE corpus are shown in Table 3.

Table 3. OOV words substitutions

English	Accepted transliterated form	Exact Hindi Translation
Net worth	йг ^^ ( net worth )	Тй^^ н^^ ( nival mulya )
South Asia	£Г5У Vf^^r ( south asia )	^Гйщ vf^^r ( dakshin asia )
Counterterrorism Strategy Initiative CoDirector	Ф1^1ё< g.RdH ф£1£Л ^^If^tifgd Ф ФТ - й1^.Фд< ( counter terrorism strategy initiative ke co director )	^Лф^т^ R-№ <ийИЛ 4^d £^ - Тй^^Ф ( aatankwad virodhi rananiti pahal sah-nideshak )
Criminal cases	f^fHdd Ф£ ( criminal case )	^Ч<||^Ф     HIHdl ( aapradhik mamla )
neither factual    nor legal	й Ф1йй Л. йТ SY 4^ф^^^ ( na hi kanuni aur na hi factual )	й ФТйй Л. йт Sr й^^|гнФ / а^йч4 ( na hi kanuni aur na hi tathyatmak/tathyapurna )
House Homeland and Security Committee	Slid   SlHd=;    чй 1£ф^1.г1 фТН^Г о ( house homeland and security committee )	йк Hid^fH Л. йгит dfHfd ( grih  matribhumi aur suraksha samiti )

C.4. Role and Thought Shifting

One news may depict thought and news in other language depicts other’s role. 16 (a) shows what a person is thinking about himself and the person’s own decision but its Hindi equivalent 16(b) leaves the decision on others.

• 16    a). Will consider PM job if we win

• 16    b). буж бтйЯ нНг жлт №н^

( saansad chahenge tabhi banunga pradhanmantri )

C.5. Syntax/Discourse Structure Changes [4, 23]

While translating 17(a) interjection is converted to assertion in 17 (b) along with same polarity substitution. Whereas 17(a) expresses surprise, 17 (b) asserts that it can never be true.

• 17    a). Kapoor {..} he didn’t believe that the minister was capable of harming her.

• 17    Ь). БТУ З^Й'Н {..} фчг зяФт нтФТ ЗН^Ф НФБ1Н нй чй^т БФН Я

(saath  unhone{..}  kapoor unki maa ko sharirik nuksaan nahin pahuncha sakte the)

C.6. Contextual Related Word

The contextual related word may be used in place of exact translation. Let word be e 1 , its exact translation be h 1 and contextual words related to E in H be h c1 , h c2 , h c3 . The contextual words h c1 , h c2 , h c3 may be used in place of h 1 (18(a) & 18(b)). In a simpler way, these are those translations, where an English lexicon can be represented by any of its Hindi synonyms.

• 18    a) I told them that the bill could be amended to address their concerns in respect of OBC and Muslim women.

• 18    b) ня ЗНБ Фйт Й 1Ф ^ЙБТ ^г -^ЧБ^ЧФ Нйнт^ФТ Яфт зяФт НТ f^HT й , зБ та фгЯФ^Нб f^H ЯБ"9ТТУН fФчт НТ БФНТ Й1

( maine unse kaha hai ki OBC aur alpsankhyak mahilaon ko lekar unki jo chinta hai, use khatm karne ke liye bill mein sanshidhan kiya ja sakta hai )

C.7. Transliteration of Synonym

In this class lexical mapping across the language is present but one uses transliterated synonym of lexical unit at the time of news reporting (19 and 20). The synonyms for hired and plea are contract and appeal respectively and these English synonyms only have been transliterated for using in the Hindi stories.

• 19 ). hired killer Ф1г^фс ТФнч ( contract killer )

• 20 ). plea — ЧГн ( appeal )

C.8. Abbreviation vs. Polysemy

In this class abbreviation is either transliterated or its expanded form is translated or transliterated. There can also be more than one translation equivalents of the same word and it is difficult to map these words across language (Table 4). Fujita [16] and Barron et al. [4] referred this class as “Altering notational variants, abbreviations, and acronyms” and “Lexicon based spelling and format changes” respectively.

Table 4. Abbreviation vs. Polysemy

Acronym	Expanded forms can be either of these
SP	БЧ1 , БНН1 ЧТЯ , Ч^Б-^УФ ( sapa,samta party, police adhikshak )
BJP	^1НЧ1 , ЯкН1^ НББ1 чтЯ ( bhajpa, bhartiya janata party )
SC	Б^Гн Ф1Я , -ББ^Б НiTH ( supreme court, anushuchit jaati )
Central Bureau of Investigation	Б141м^ , ФЯ-ч -^^чи ®б<1 ( CBI, kendriya anveshan bureau )
CBI	Б141м^ , ФЯч -^^чи ®б<1 ( CBI, kendriya anveshan bureau )
RBI	R^j ^ф , мг 41 м^ ( reserve bank, RBI )
Sgt	БтНя ( seargent )
Lt	Hi^cHc ( leutinent )
Gen	нягн ( general )

C.9. Sentimental Outburst to Add Sensation

In this category some phrase, idioms and words arousing emotional outburst may be added across the language (21 (a) & 21 (b)). Here “ БТНЙФ ^^фН

( saamuhik dushkarm )” is not the exact translation of rape but has simply been used to arouse sensation.

• 21    a). 12 rape girl on panchayat order

• 21 b). Ч^н Ф> мй^ чг ?3 НТлТ ЯТФ^Т БТН^Ф ^^^н

( panchayat ke aadesh par 12 logon ne kiya saamuhik dushkarm )

D. Level IV

Translations falling under this category come under pragmatic paraphrasing which have been dealt by several researchers. As special types of paraphrases it goes beyond pure semantic similarity to fall within the field of pragmatics [24]. Paraphrasing extends to a group of words. Linking and tracking news stories under this class becomes quite challenging.

D.1. Action vs. Consequence

22 a). All pre-2005 notes go out of currency

22 b). ЩЧЯ ЯтЯЙЯ 2005 ЙЧ£Й Я ЯЙГ ЯГЯ

( wapas karne honge 2005 se pahle ke sabhi note )

E.2. Total Rephrasing (High Obfuscation)

• 37 a). Minister had already assured the House that all parties would be taken into confidence by the government on the issue.

• 37 b). <нИМ ЭТТ^Л f^J ЧТ Л$нТ^ ФТ9Л ФТ4 Ф Uu Н Л 4 ЛУч4|^ Зоф 3 Л$ ^1

(mahila aarakshan bill par sahmati kaayam karne ke liye mantri ne sarva daliya baithak bulayi hai)

• 38 a). "...Nothing is found against the correctness, legality, propriety or regularity in respect of any of the findings”

• 38 b). ^л4 Ф ГЙЫ1* Ф1^ оГл ^^гл Ч^т л£г Ф ^ti

(faisle ke khilaph koi thos dalil pesh nahi ki gayi)

Table 5 shows complete typology for English-Hindi Journalistic Text Reuse

• IV.    D iscussion

  Authors participated in the Cross Language Indian News Story Search (CLINSS) task of FIRE 2013 where the task was to link relevant Hindi news stories reporting the same focal event out of a corpus of 50691 stories to their 25 English counterparts. They tried to analyze and identify occurrences of the different paraphrase types as proposed in this typology in the top ten Hindi news stories which were retrieved as the result of the CLINSS task. Out of 250 documents retrieved, 50 were found to be relevant. The relevancy was judged on the basis of whether the document pairs shared the focal event and news event both or only the news event and not the focal event. Those documents which shared the focal events too, showed the tendency of exact translations of group of words occupying major portion in the corpus. Loan words or OOV substitutions was also used frequently in case of equivalent Hindi document. Polysemy hypernymy and hyponymy (specification vs. generalization) and synonymy (contextual related words) also was present in the corpus. Word insertions and deletions and sentence split/join are done to present the same facts with some additional information. The other classification categories were mostly observed in the documents which shared the same news event but different focal event. Different wordings due to change of focal event might have been the reason behind it.

• V.    C onclusion

Defining typologies helps in drawing boundaries to identify across language different equivalent manifestations and helps devising or developing techniques for accurately tracking news stories across language. The analysis of relevant Hindi news stories having the same focal or main event as their English equivalents for different classification types English-Hindi News stories corpora are suggestive of the facts as to which of the paraphrase types are mostly observed in cross-lingual reuse. This analysis may prove beneficial to track and link two such cross-lingual English-Hindi story pairs if proper techniques are devised for dealing with the most prominent paraphrase types.

The work is a novel step towards constructing a paraphrase typology for English Hindi news corpora. The proposed work has tried to bring forth the intricacies involved across the language journalistic text reuse. The paraphrase boundaries are in most of the cases overlapping so the work can be further analyzed to redefine the boundaries to deepest sub-level so that overlapping is reduced to an extent.

A cknowledgements