Scopus İndeksli Yayınlar Koleksiyonu / Scopus Indexed Publications Collection
Permanent URI for this collectionhttps://hdl.handle.net/11147/7148
Browse
8 results
Search Results
Article Citation - WoS: 1Citation - Scopus: 1Automating Software Size Measurement With Language Models: Insights From Industrial Case Studies(Elsevier Science Inc, 2026) Unlu, Huseyin; Tenekeci, Samet; Kennouche, Dhia Eddine; Demirors, OnurObjective software size measurement is critical for accurate effort estimation, yet many organizations avoid it due to high costs, required expertise, and time-consuming manual effort. This often leads to vague predictions, poor planning, and project overruns. To address this challenge, we investigate the use of pre-trained language models - BERT and SE-BERT - to automate size measurement based on textual requirements using COSMIC and MicroM methods. We constructed one heterogeneous dataset and two industrial datasets, each manually measured by experienced analysts. Models were evaluated in three settings: (i) generic model evaluation, where the models are trained and tested on heterogeneous data, (ii) internal evaluation, where the models are trained and tested on organization-specific data, and (iii) external evaluation, where generic models were tested on organization-specific data. Results show that organization-specific models significantly outperform generic models, indicating that aligning training data with the target organization's requirement style is critical for accuracy. SE-BERT, a domain-adapted variant of BERT, improves performance, particularly in low-resource settings. These findings highlight the practical potential of tailoring training data for broader adoption and cost-effective software size measurement in industrial contexts.Article Citation - WoS: 1Citation - Scopus: 1Application of a Size Measurement Standard for Data Warehouse Projects(Wiley, 2024) Unlu, Hueseyin; Yueruem, Ozan Rasit; Yildiz, Ali; Demirors, OnurMethodologyIn this research, we conducted a case study to establish a foundation for size measurement and effort estimation in DWH projects. We first applied a productivity-based estimation approach using linear regression with the ISBSG repository to assist organizations without historical data. We then evaluated various machine learning algorithms to improve estimation accuracy. Finally, we tested a combined model that integrates both approaches for estimating effort in external projects.ResultsUsing the ISBSG dataset, linear regression models based on productivity achieved a Mean Magnitude of Relative Error (MMRE) of 0.285. Machine learning algorithms improved accuracy by 22.81%, reducing the MMRE to 0.220. The final model, applied to external projects, yielded MRE values between 0.010 and 0.245.ConclusionThe ISBSG repository is a valuable resource for effort estimation in DWH projects. Combining productivity-based estimation with machine learning enhances accuracy and predictive performance, making it a more reliable approach than traditional models.Conference Object Citation - Scopus: 8An Exploratory Case Study on Effort Estimation in Microservices(Institute of Electrical and Electronics Engineers Inc., 2023) Unlu,H.; Hacaloglu,T.; Omural,N.K.; Caliskanel,N.; Leblebici,O.; Demirors,O.Software project management plays an important role in producing high-quality software, and effort estimation can be considered as a backbone for successful project management. Size is a very significant attribute of software by being the only input to perform early effort estimation. Even though functional size measurement methods showed successful results in effort estimation of traditional data-centric architectures such as monoliths, they were not designed for today's architectures which are more service-based and decentralized such as microservices. In these new systems, the event concept is highly used specifically for communication among different services. By being motivated by this fact, in this study, we looked for more microservice-compatible ways of sizing microservices using events and developed a method accordingly. Then, we conducted an exploratory case study in an organization using agile methods and measured the size of 17 Product Backlog Items (PBIs) to assess how this proposed method can be useful in effort estimation in microservices. The implication from the case study is that despite performing a more accurate effort estimation using the proposed size measurement than COSMIC, we were unable to significantly outperform using the total number of events. However, our suggested approach demonstrated to us a different way to use software size in terms of events, namely, to determine the coupling complexity of the project. This finding can be beneficial specifically when evaluating the change requests. © 2023 IEEE.Conference Object Citation - Scopus: 1A Survey on Cosmic Students Estimation Challenge(CEUR-WS, 2022) Hacaloğlu, Tuna; Say, Bilge; Ünlü, Hüseyin; Küçükateş Ömüral, Neslihan; Demirörs, OnurSoftware project management is a significant software engineering practice that is highly related to achieving software-specific project goals. This study aims to share students’ perceptions of incorporating an international software estimation challenge called “COSMIC Students’ Estimation Challenge” into a software project management course. For this aim, students were taught the COSMIC Functional Size Measurement method and entered the competition. After the competition, a questionnaire asking for the students’ opinions was collected. The objective of the research is to get an insight into to what extent incorporating this type of competition activity -a challenge- can contribute to students’ learning perceptions. In the long run, the findings can contribute to creating a foresight about making the necessary curriculum arrangements to form a more up-to-date and dynamic education plan by including the methods applied in the software industry in Software Engineering education. The results suggest that this kind of competition experience and preparation is helpful for students to learn the COSMIC method.Conference Object Cosmic Light Vs Cosmic Classic Manual: Case Studies in Functional Size Measurement(CEUR Workshop Proceedings, 2020) Hacaloğlu, Tuna; Ünlü, Hüseyin; Demirörs, Onur; Abran, AlainFunctional size has been used in software engineering for more than 40 years. When measured early in the software development life cycle, it can serve as direct input for effort estimation. The COSMIC Functional Size Measurement (FSM) method developed by the Common Software Measurement Consortium (COSMIC) is the latest ISO-compliant functional sizing method. A streamlined manual titled ''Software Development Velocity with COSMIC Function Points'' summarizes the measurement process and shortens the learning time. The aim of this study is to compare the classic COSMIC FSM manual and this new “light” manual in terms of accuracy of the resulting FSM applied to case studies. The findings show that use of the light manual results in accurate measurement. In addition, there were no significant time differences between the two. With respect to the variations in COSMIC Function Points (CFP) values in the two case studies, they three causes were identified: the Object of Interest (OOI) concept and corresponding data groups, details regarding Functional Process Independence, and Error/Confirmation messages related to the scope of the information included in the manuals. Copyright © 2020 for this paper by its authors.Conference Object Citation - WoS: 1Citation - Scopus: 3Automated Estimation of Functional Size From Code(IEEE, 2020) Özen, Özgesu; Özsoy, Bora; Aktılav, Busenur; Güleç, Eren Can; Demirörs, OnurDetermination of the size of a software project is challenging as well as crucial for both self-employed software developers and corporate businesses. That's why it is subjected to a lot of academic studies where it is discussed how to determine the size more accurately. Functional Size Measurement (FSM) is one the most popular measurement techniques for a software from the point of the delivered functionality. However, the aspects of know-how, the cost, time, and manual operation creates difficulties to apply FSM techniques. This study aims to solve these issues by automating the measurement process to approximate the functional size of a project using the COSMIC Functional Size Measurement. The end product of this study is called 'Cosmic APP' that utilizes the sequence diagram of a software after reverse engineering it from the given code using a third-party tool called 'SequenceDiagram'. The working principles, the estimation process, and the obtained results of 'Cosmic APP' are described thoroughly in this paper. © 2020 IEEE.Conference Object Citation - WoS: 15Citation - Scopus: 20Measureability of Functional Size in Agile Software Projects: Multiple Case Studies With Cosmic Fsm(IEEE, 2019) Hacaloğlu, Tuna; Demirörs, OnurFunctional size measurement (FSM) has been used in software engineering for decades as a main driver for estimation and significant input for other various project management activities throughout the project life span. To apply FSM accurately at the early stages of software development process, especially for estimation purposes, functional user requirements need to be available in detail as required by the adopted FSM method. However, in agile software development, requirement specifications, in general, are kept minimal. For this reason, the adjustment of the requirements to the necessary granularity level has been articulated as one of the barriers preventing the diffusion of FSM practices among agile teams. In this paper, we take a closer look at this problem in order to investigate the usability of FSM and to reveal FSM related challenges empirically through case studies on real agile projects from different software organizations. This study also provides a snapshot of agile organizations in terms of requirement specification and estimation related practices. © 2019 IEEE.Conference Object Citation - Scopus: 41Effort Estimation for Agile Software Development: Comparative Case Studies Using Cosmic Functional Size Measurement and Story Points(Association for Computing Machinery (ACM), 2017) Salmanoğlu, Murat; Hacaloğlu, Tuna; Demirörs, OnurAgile methodologies have gained significant popularity among software development organizations during the last decade. Although agile methodologies are regarded as minimizing formal processes, they still utilize an estimation methodology for proper management. Story point is the most common input for agile effort estimation. Story point is an arbitrary measure; it reflects experiences of project participants. On the other hand, functional size is an alternative measure used in practice as an input for effort estimation. In this research, we collect and present the outcomes of three case studies which compared the effectiveness of COSMIC-based and story point based effort estimation in agile context. On selected projects of these organizations, software functional size was measured with COSMIC functional size measurement methodology. Effort prediction models were formed by using COSMIC size and actual effort spent; and the models were tested in terms of their effectiveness. The results show controversial outcomes. For all the cases, COSMIC based estimation was more precise. Therefore, COSMIC is an appropriate measure to estimate the effort in organizations that adopt agile software development. It is also observed that COSMIC allowed for computing productivity which has less disperse distribution than the productivity computed with SP. The data is also provided to help other researchers conduct their own studies.