TR-Dizin İndeksli Yayınlar Koleksiyonu / TR Dizin Indexed Publications Collection
Permanent URI for this collectionhttps://hdl.handle.net/20.500.11779/1927
Browse
6 results
Search Results
Article Mention Detection in Turkish Coreference Resolution(Tubitak Scientific & Technological Research Council Turkey, 2024) Demir, Seniz; Akdag, Hanifi IbrahimA crucial step in understanding natural language is detecting mentions that refer to real-world entities in a text and correctly identifying their boundaries. Mention detection is commonly considered a preprocessing step in coreference resolution which is shown to be helpful in several language processing applications such as machine translation and text summarization. Despite recent efforts on Turkish coreference resolution, no standalone neural solution to mention detection has been proposed yet. In this article, we present two models designed for detecting Turkish mentions by using feed-forward neural networks. Both models extract all spans up to a fixed length from input text as candidates and classify them as mentions or not mentions. The models differ in terms of how candidate text spans are represented. The first model represents a span by focusing on its first and last words, whereas the representation also covers the preceding and proceeding words of a span in the second model. Mention span representations are formed by using contextual embeddings, part-of-speech embeddings, and named-entity embeddings of words in interest where contextual embeddings are obtained from pretrained Turkish language models. In our evaluation studies, we not only assess the impact of mention representation strategies on system performance but also demonstrate the usability of different pretrained language models in resolution task. We argue that our work provides useful insights to the existing literature and the first step in understanding the effectiveness of neural architectures in Turkish mention detection.Article Innovation and Productivity Research in the Last Five Decades: a Bibliometric Analysis(2024) Çelik, DeryaPurpose: This study aims to reveal research trends by revealing the evaluation in this field by making a holistic analysis of academic studies that have examined the concepts of innovation and productivity in the last five decades. This analysis aims to reveal the general structure of academic studies that deal with the concepts of innovation and productivity. Methodology: Articles searched in the ‘‘Social Science Citation Index (SSCI)’’, ‘‘Science Citation Index Expanded (SCI-EXPANDED)’’ and ‘‘Emerging Sources Citation Index (ESCI)’’ in the ‘‘Web of Science (WoS)’’ database, researching innovation and productivity together between 1980-2023. It was analysed and mapped using the VOSviewer 1.6.19 software and manual methods. Co-occurrence Keyword Analysis, Document Co-citation Analysis and manual analysis methods were used in the mapping. Findings: This study reveals how research in innovation and productivity has developed over the last five decades and what trends it has. It has been determined that the most published areas are Economy, Management and Business. The most frequently used keywords were found to be "innovation", "productivity", "research-and-development", "growth", "performance" and "impact". The most published topics on a cluster basis are "impact", "innovation and productivity", "growth", "research and development" and "performance", respectively. In the document co-citation analysis, it was determined that the publication in which all publications were linked included the study titled "Research, Innovation and Productivity: an econometric analysis at the firm level", published by Crépon et al. (1998). This information can be a valuable resource for future research and policy-making and can be used to drive innovation and productivity progress. Originality: While the study is the first and only content analysis to reveal the combined trends in this field by examining the "innovation and productivity" studies together, it is thought that the results obtained can guide researchers and professionals.Article Neural Coreference Resolution for Turkish(2023) Demir, ŞenizCoreference resolution deals with resolving mentions of the same underlying entity in a given text. This challenging task is an indispensable aspect of text understanding and has important applications in various language processing systems such as question answering and machine translation. Although a significant amount of studies is devoted to coreference resolution, the research on Turkish is scarce and mostly limited to pronoun resolution. To our best knowledge, this article presents the first neural Turkish coreference resolution study where two learning-based models are explored. Both models follow the mention-ranking approach while forming clusters of mentions. The first model uses a set of hand-crafted features whereas the second coreference model relies on embeddings learned from large-scale pre-trained language models for capturing similarities between a mention and its candidate antecedents. Several language models trained specifically for Turkish are used to obtain mention representations and their effectiveness is compared in conducted experiments using automatic metrics. We argue that the results of this study shed light on the possible contributions of neural architectures to Turkish coreference resolution.Article Citation - WoS: 1Citation - Scopus: 2Determining and Evaluating New Store Locations Using Remote Sensing and Machine Learning(Tübitak, 2021) Ünsalan, Cem; Turgay, Zeynep Zerrin; Küçükaydın, Hande; Höke, BerkanDecision making for store locations is crucial for retail companies as the profit depends on the location. The key point for correct store location is profit approximation, which is highly dependent on population of the corresponding region, and hence, the volume of the residential area. Thus, estimating building volumes provides insight about the revenue if a new store is about to be opened there. Remote sensing through stereo/tri-stereo satellite images provides wide area coverage as well as adequate resolution for three dimensional reconstruction for volume estimation. We reconstruct 3D map of corresponding region with the help of semiglobal matching and mask R-CNN algorithms for this purpose. Using the existing store data, we construct models for estimating the revenue based on surrounding building volumes. In order to choose the right location, the suitable utility model, which calculates store revenues, shouldbe rigorously determined. Moreover, model parameters should be assessed as correctly as possible. Instead of using randomly generated parameters, we employ remote sensing, computer vision, and machine learning techniques, which provide a novel way for evaluating new store locations.Article Citation - WoS: 4Citation - Scopus: 6Consumer Loans' First Payment Default (fpd) Detection and Predictive Model(TUBITAK SCIENTIFIC & TECHNICAL RESEARCH COUNCIL, 2020) Sevgili, Türkan; Koç, Utku; Koç, UtkuThe project is based on the opinion that whether the loan applications which are profitable could be granted instead of prone the default (FPD) ones by using predictive models in machine learning by the credit decision authorities in banking sector. Default Loan (also called non-performing loan) occurs when there is a failure to meet bank conditions and cannot be repaid in accordance with the terms of the loan which has reached its maturity. This report is a research effort in the analysis of default loan applicants, especially FPD, from a real dataset obtained from a bank. Expectation from the study is that increase the efficiency of consumer loan allocation by providing predictive analysis of the consumer behavior concerning loan’s first payment default. FPD detection analysis is a crucial role for the determination of consumer loans at the application level. The study also provides an understanding on the reasons of non-performing loans and helps to manage credit risks more consciously. The methods proposed in this study can be extended to other individual consumer loans such as car credits and mortgage.Research Project Özyinelemeli Sinir Ağları ile Türkçe Doğal Dil Üretimi(TÜBİTAK, 2018) Demir, Şeniz; Gökmen, Muhittin; Gökmen, Muhittinİnsanlar arasındaki iletişimi sağlayan doğal diller, zaman içinde insanlarla etkin ve kullanıcı dostu etkileşim kurabilmek amacıyla sistemler ve yazılımlar tarafından kullanılmaya başlanmıştır. Tıpkı insanlar gibi sesli veya yazılı doğal dil ifadelerini anlayabilen ve sonrasında kullanıcıların beklentilerini karşılayabilen dil tabanlı teknolojiler (örn. arama motorları, bilgisayar destekli eğitici sistemler ve diyalog sistemleri) bu motivasyonla ortaya çıkmıştır. Bu çalışmalarda, problemin doğası ve hedef dilin yapısındaki zorluklara ek olarak insanların doğal dilleri nasıl öğrendiğini ve kullandığını modellemedeki kısıtlar başarım oranlarını etkilemiştir. Günümüzde, dil tabanlı teknolojiler insanlar tarafından yaygın şekilde kullanılıyor olsalar da (örn. Google Arama Motoru ve Apple Siri), ulaşılan teknolojik seviye hedef dile göre çeşitlilik göstermektedir. Sondan eklemeli ve zengin dil yapısı ile Türkçe geliştirilen teknolojik çözümler ve üretilen veri kaynakları açısından pek çok doğal dilin gerisinde kalmaktadır. Ayrıca, bugüne kadar Türkçe dil teknolojileri konusunda yapılan çalışmaların ağırlıklı olarak dili işleme, anlama ve analiz etmeye dönük (örn. kelimelerin morfolojik analizi, özel isim tespiti, bağlılık çözümlemesi, metin sınıflandırma ve metin özetleme) olduğu gözlemlenmektedir. Türkçe dil üretimi konusunda sınırlı yeteneklere sahip ve akademik seviyede kalarak devamı getirilmemiş birkaç çalışma mevcuttur. Fakat bu çalışmalar karmaşık sayılabilecek dilbilimi teorileri ile ifade edilen içerik ifadelerini cümlelere dönüştürmekten öteye geçmemiştir ve başka uygulamalarla entegre olarak test edilmemiştir. Bu çalışmada, Türkçe dilinin derin öğrenme tabanlı bir sistem (dil aracı) ile otomatik olarak üretimi hedeflenmektedir. Bu sistemin, girdi olarak verilen içerik ifadelerini Türkçe dili kurallarına uygun ve anlaşılır cümlelere dönüştüreceği öngörülmektedir. Literatürdeki en kapsamlı Türkçe dil üretimi sistemi olması planlanan bu çalışmada son yıllarda pek çok dil teknolojisinde başarımı ispat edilmiş diziden diziye öğrenebilen (örn. kelime dizisinden başka bir kelime dizisi) özyinelemeli sinir ağı yapıları kullanılacaktır. Bu ağların sağladığı dinamiklik ile farklı çeşitler (örn. uzun kısa süreli bellek ve girişli özyinelemeli birim) ve genişlemeler (örn. dikkat mekanizması) denenecektir ve başarımı en yüksek sinir ağı mimarisi belirlenecektir. Buna ek olarak, sinir ağlarının kullanımı bazı faktörlerin (örn. bağlam bilgisi ve kullanıcı tercihleri) sisteme entegrasyonuna ve üretim aşamasına olan etkilerinin incelenmesine imkân sağlayacaktır.
