Big Data trend in software development, in media and communication, in the development of economy and society

Автор: Davidov T., Vojinovic M.

Журнал: International Journal of Management Trends: Key Concepts and Research @journal-ijmt

Статья в выпуске: 1 vol.4, 2025 года.

Бесплатный доступ

With the development of society, the economy, the development of innovative technology and technological equipment, the development of modern web software solutions, there is a constant tendency to increase the amount, variety and quality of data. The need to accommodate a huge amount of data implies the use of new technologies that are able to process new data dimensions. Virtually all participants in the social system, from large web companies to traditional entrepreneurs, researchers and scientists, are facing a disproportionate and lightning-fast growth in the amount of data (Jinchuan CHEN, 2013). The available data is of diverse content and format, and the method of their processing, generation and analysis is a challenge for modern Big Data technologies, which we will deal with in this paper. Big Data technologies create new opportunities for exploiting the value and potential of increasingly extensive and diverse data. This paper describes Big Data technologies, the reasons for their application and the challenges of big data from the point of view of data management. The technology of storing, hosting, mining and manipulating big data is described in several dimensions supported by Big Data. We compared the role and way of using traditional databases, versus Big Data technologies that take on a role in the economy and society, in web companies or classic commercial and non-commercial organizations. In this regard, it was pointed out the irreplaceable need for the implementation of Big Data technologies in all economic entities and the entire social system, as well as their role on the Internet in the development of social networks.

Еще

Big Data, traditional databases, communication, software system, Hadoop technology

Короткий адрес: https://sciup.org/170209500

IDR: 170209500   |   DOI: 10.58898/ijmt.v4i1.47-57

Текст научной статьи Big Data trend in software development, in media and communication, in the development of economy and society

Today, large data systems have an important role and an even more important influence on the development of economic and non-economic activities, as well as all categories and structures of social development. A large system is a complex entity and involves a variety of skills: technique, methodology, technology, infrastructure, organization, knowledge, connectivity, accuracy, utility, and more. A great system means great responsibility.

(сс) ©    © 2025 by the authors. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license .

In front of such systems, the question is constantly raised: in what way will the modern system be able to improve its scalability, technical readiness and operability, so that such a system would support the improvement of business based on the development of the business environment? Technologies significantly help and participate in the development of businesses. Development implies knowledge, information, and data. The higher the quality of the information, the more substantial the knowledge. The system must necessarily support the use of data and work with data at all levels and in all data. The more perfect the technology for working with data, the more capable and cost-effective the system is. With the development of technologies, the content, amount and range of data increases. There is a growing need for a system that will support the processing of a huge amount of data, so that the data becomes useful information for the area in which the business activity of the company will develop and improve. Only companies that have to the ability to accommodate, develop and support a huge amount of scattered data have a high degree of certainty to survive and compete in the modern market game. Flexible work with big data must be the goal of every company or institution of modern society. This work is dedicated to the opportunities offered by modern technologies that work with big data. Technology and its influence on the future development of economic subjects, the health system and other physical subjects will be presented, which is multidimensionally useful to the social community.

BigData technologies are the key to business

Technologies are a reflection of the development of society, companies, and individuals. Depending on how developed technologies are, it is possible to develop the system, the environment, and the individual. Finally, technologies have a significant economic relationship to the system in which they exist. First, modern technologies cost more and more, because it means investing in equipment, knowledge, and personnel. However, it gives results in the long term, such business conditions provide support for accelerated and increasingly complex development. Developed technologies participate in maximizing profits and minimizing costs, with an emphasis on product or service quality, with one very simple goal: to make the end user satisfied. Today, current big data technologies are becoming an almost irreplaceable parameter in the development of a software system in any serious company or institution. Big data has become an innovative but also a necessary trend. Big data technologies are able to create, process, formalize and generate increasingly demanding and detailed data and information in all areas. Backend software data is increasingly complex and requires more and more information. The information that is accepted from the outside world is less and less formalized, that is, it has more and more scattered content. The data, and in the last instance, the generated information, are more and more comprehensive and voluminous.

The tremendous growth of data has improved the infrastructure in the information technology (IT) industry. Traditional relational databases have become insufficiently flexible and too formalized for informal, overly voluminous, unstructured data. Unusual data cannot be placed in a formally controlled model, such as the Relational Data Model, on which the development of relational databases in current IT practice is based. In the field of data storage, IT technologies are being developed according to a new and completely different approach, which is called: a new dimension of databases, i.e., Big Data. Big data technologies have become an irreplaceable category for processing these overly voluminous amounts of data.

BigData develops technology in 5 dimensions

Big Data technology is a challenge of modern technological development. Databases are built on mathematical set theory. Thus, Big data represents a technology based on sets of data that synchronize several dimensions. It is estimated that these data sets exceed the sizes and dimensions that can be implemented in standard software solutions for data storage, management and processing in an acceptable amount of time. These complex data sets are implemented in Big Data dimensions that support five important Big Data concepts that go beyond the capabilities of current data processing technologies:

  • 1.    Volume,

  • 2.    Velocity i

  • 3.    Variety.

  • 4.    Veracity and

  • 5.    Value

The five main "dimensions" of big data technology are usually presented as a formula: 5V Big Data technology. This technology is used today in solving real problems of large amount of data in real time flow.

Figure 1. The five V’s of Big Data (Jose Andre Moura & Carlos Serrão, 2015)

Volume of data in Big Data technology

A challenge such as the volume of data is actually the most significant in the development of BigData technology. In sciences such as biology, meteorology, astronomy, etc., there is a constant need to increase computing performance that meets the possibility of storing increased volumes of data. Today, in a technological sense, data is informalized, presented in graphs, images, and large texts, which generate an ever-increasing volume, and the management of such data is increasingly complex, difficult and demanding. Social networks manage a huge amount of data of complex structure (Jinchuan CHEN, i drugi, 2013). Communication between individuals requires the reception of large data in the shortest possible time so that communication can be realized in a timely and high-quality manner.

Velocity of data in Big Data technology

The speed of processing large amounts of informal data is a major challenge for technologies. This challenge was generated due to the need to solve the automation of new data entry, where the speed of their processing is of great importance. Also, updating existing data is very important to process quickly and efficiently. The issue of input and updating is particularly related to data that is generated on the computer during the work process, such as that created by sensors or mobile devices. These are specific data formats that Big Data technologies recognize and process quickly.

Variety of data in Big Data technology

Application software that is used in a real environment, accepts input and generates output data. Input data generally does not come from a single source, nor are the forms of that data unambiguous and uniform. Big data implementations require handling data from different sources, which are often of different formats and models. Large amounts of data speak to the specificity and size of the data entering 50

the system. First of all, they are of very large dimensions, such as videos, images, recordings from various technical devices (magnetic resonance, monitoring system, sensor, various software tools, etc.). The different dimensions of data generate the problem of their acceptance: how to "capture" different types of data in a way that enables recognition and connection of their meaning for the purpose of generating information. Typically, diverse data can be classified into three general types of data:

  • 1.    structured,

  • 2.    semi-structured i

  • 3.    unstructured data.

The distribution of data and its processing in the big data system is shown in the figure. According to the steps shown in the picture, the data are integrated, their meaning is unified. Then there is a reduction of unnecessary data and the final presentation of the cleaned data on which queries are made and their indexing, which increases the speed of the search and obtaining quality information.

Figure 2 Big data processing steps (Jinchuan CHEN, i drugi, 2013)

Databases - relational or BigData

The data is formatted in the database within the framework of static formats of the relational database. Traditionally, data mainly consists of static paper documents in text formats or is formally structured so that it can easily be stored in a traditional relational database system. However, in recent times, the storage of data in uniform, traditionally structured formats have become insufficiently flexible and very limited. Data is increasingly bulky and is created in the form of different formats, given that it is formed by various new and modern technological devices. In Big Data databases, such data can be recognized and become usable for processing. The presentation of such data is the result of an 51

Table 1

Basic differences between the characteristics of traditional databases and the characteristics of big data (Zeituni Baraka, 2014) .

Traditional DBMS characteristics Big data database characteristics

Data

characteristics

  • •    Weak in handling non-structured data

  • •    Does not learn from user access behavior

  • •    Real time live data

  • •    Environment supports all types of data and from all types of sources

  • •    Appropriate for handling petabytes and exabytes of data

  • •    Learns from user access behavior

Considerations for analytics

  • •    Is appropriate for analysis of data containing information that will answer to information gaps that are known

  • •    Stable data structure

  • •    Passive user experience- the user simply retrieves information

  • •    Focus on attribute search

  • •    Data management simplified

  • •    Historical data management 2 dimensional

  • •    Limited inter organizational data access

  • •    Analytical capabihty expectations are minimal

  • •    A lot of parallel processing often strains supporting systems

  • •    Can be truly ground-breaking for organization's as previously completely unknown gaps of information can be revealed randomly rather than just providing information about what is known- is not know

  • •    Emergent data structure

  • •    Active user experience- the system may initiate discourse that may need attention

  • •    Focuses on historical pattern, trend, multi-dimensional search

  • •    Rich multi-channel knowledge access

  • •    Real-time analytics technologies plays a vital role

  • •    Analytical capabilities expectations may be too high

Relevant technologies

  • •    Implementation straight forward

  • •    SQL is most common language

  • •    Relational database function model

  • •    Not open source

  • •    Analytics is done on batch jobs containing aggregated data which is historical data rather than real-time data

  • •    Implementation more complex due to lack of industry standards and direction

  • •    No SQL but near on SQL compliant

  • •    Ha do op framework

  • •    Open Source is appropriate

  • •    Stream processing capability is often relevant

Data

Unstructured data

Text data                                                Untext data

Figure 3. Structured and unstructured data (source: author)

A branch of unstructured data and textual data, or non-textual data, such as graphics, images, videos, sensor formats, etc. all together become complicated and complex to process, and that branch is directed towards the development of new technologies for storing and processing data, BigData.

Unstructured data - Big Data

Unstructured data is basically information that either does not have a predefined data model or does not fit well into a traditional database: This data includes data presented as:

  •    text,

  •    pdf document,

  •    video,

  •    pictures,

  •    audio,

  •    geospatial data,

  •    internet data,

  •    slick streams,

  •    log files

  •    x-rays

  •    data of biometric and monitoring devices

  •    data generated by sensor devices, etc.

The role of Big Data in society, economic and non-economic branches

The term Big Data refers not only to data, but also to technologies that ensure their purposeful processing. Hadoop, currently the most famous Big Data Technology, is presented in the form of a distributed system for storing and processing large amounts of structured and unstructured data. Apache Hadoop is an open-source distributed storage and processing system. Apache Hadoop is an open-source system for distributed storage and processing of diverse data, created at a time when the amount of data exceeds the memory capacity of computer systems. A significant role in Big Data is played by Hadoop, NoSQL databases, Apache spark, etc. (Vernes Vinčević & Mahir Zajmović, 2021). With the development of technological achievements and technical devices that generate unstructured data formats, the need for data processing through Big Data technologies is created in companies. These complex data structures are not supported by traditional software products for processing data. They cannot download them, manage them or process them in a reasonable amount of time. How much data can one of the Big Data technologies accept or process? Most of the time it is not very clear, but usually it is about several terabytes, petabytes and even exabytes.

Every company has a need to process data as quickly and consistently as possible. Because if Big Data is the support for a product to be advertised, clearly, in-depth and detailed , graphically, then surely Big Data must studiously accept, accommodate, process and analyze a very scattered amount of data about the product. With this analysis, any information about the product is above all fast, accurate, clear, precise, unambiguous and presented in the most consistent way. Such numerous and varied information about a product can so clearly and graphically present and bring the product closer to the future customer that the sale of such a product could be much faster and more efficient, even up to 100% more

Big Data is represented on social networks, and this is actually the first and initial role of big data in communication with users. However, everything that surrounds us is turning into a global planet of producers and consumers of products and services. The more detailed and purposeful the description of both the raw material and the finished product, the more clearly some information is presented, the more details there are about an item, service, product, project, the more attractive the given object will be to the person for whom it is intended. Data is important. Data is all around us and Big Data technologies are the future of all technologies.

If we look at services, we can highlight services that are important to people's lives, such as the health system. In this regard, it is necessary to include a significant development of technologies and many professional experts in the development of an expert system for the needs of society. Big Data has an irreplaceable role in which new healthcare systems must be built. There is more and more data in the current healthcare software, so the old technologies are not able to support it. Only realistic and accurate information in health care can have an impact on saving human life, if life is in danger. The speed, variety, size, accuracy, depth of analysis, precision and comprehensiveness of the information are of key importance here, which provides a sense of security in case of making important decisions for the patient's life or health.

The speed of storage, recognition, classification, structuring, processing, generation of information and reporting from the set of obtained results is unthinkable without Big Data technologies. Today, in society, every social phenomenon or natural analysis has become dependent on these technologies , such as weather forecasting. At the state level, state institutions can use Big Data technology to get the safest and most reliable information possible. If we look at various branches of social development, for example agriculture: how much only Big Data technologies would help in decision-making and the introduction of various modern systems into processes and workflows. The development of a software solution based on Big Data technology would help many activities: cultivation, sowing, storage, accommodation, purchase, sale, advertising or any segment of the production process of that economic branch.

Hadoop - BigData technology

Hadoop is a software framework derived from two prominent Big Data technologies: MapReduce and BigTable. Hadoop allows MapReduce-based applications to manage large clusters on user hardware. This project represents the foundation of the computer architecture of Yahoo! business processes. Hadoop is designed to speed up information processing and computation by processing across computing nodes, as well as to hide latency.

Figure 4: Apache Hadoop ecosystem (Stipe Batinica, 2018).

As already mentioned, Big Data technology is developing to process data of undefined sizes and to do the same at a disproportionate speed. Once technology master the way to analyze and "mine" large amounts of data, it can bring great value for the funds invested in Big Data. Hadoop technology processes data, but at the same time it faces great challenges. Given that unstructured data has dynamic, heterogeneous, interconnected, disconnected and sometimes insufficiently reliable properties, analyzing and "mining" big data is very challenging.

Conclusions

Big Data is becoming an important branch of IT industry development. Soon these databases will assume the role of primary databases. Under these conditions, in the near future, relational databases will only sometimes be used on certain systems where it is necessary due to the accuracy of information that, for example, refers to financial or similar data, which are related to legal frameworks. With this data, their form and structure are of paramount importance. The use of big data to guide business activities, production processes, social and government decisions, where people have a primary role, requires that "deep data analysis" be carried out, instead of generating it with simple forms and formulas for reports. This type of complex analysis must depend on complex models and could hardly be expressed in a simple SQL language, which is applied to structured data. In order to make some active preparations, people must actively participate in the storage, analysis, generation and completion of big data that are processed by Big Data technologies. People must be an active parameter and factor in the creation of information, both through their work and mutual relationships and communication. People who participate must know what is happening now but also predict what will happen in the future. Users must analyze the data at their disposal with the help of modern technologies and modern software systems, or expert systems based on Big Data technologies.

Статья научная