Journal of Generative Intelligence E: 3117-6429 P: 3117-6437
type: channel
description: Journal Insights Editor-In-Chief: Dr. Sergey Garchenko Title proper: Journal of Generative Intelligence ISSN: 0000-0000 Subject: Science and knowledge in general. Organization of intellectual work. Publisher: GalaxiaUniverse Dates of publication: 2024 Frequency: Quarterly Language: English Country: Netherlands Medium: Electronic Version Open Access: Yes Licensing: CC BY-NC-ND license Title DOI of the Journal: https://doi.org/ ORCiD ID: https://orcid.org/ Contact: editor@galaxiauniverse.com Important Tools: English Grammar Checker Plagiarism Checking Proofreading Publishing Timeline: |Time to First Decision: 1 Month| Time to Final Decision: 2 Months| Publication Time: 2 Months| Acceptance Rate: 38% The Journal of Generative Intelligence, also known as the Journal of Generative Artificial Intelligence, is a scholarly interdisciplinary publication dedicated to pioneering research in the field of generative AI. It serves as a platform for high-quality, peer-reviewed articles, reviews, and surveys that significantly advance understanding and application of generative intelligence technologies. Journal Summary: p]:pt-0 [&>p]:mb-2 [&>p]:my-0" style="box-sizing: border-box; scrollbar-color: initial; scrollbar-width: initial; --tw-border-spacing-x: 0; --tw-border-spacing-y: 0; --tw-translate-x: 0; --tw-translate-y: 0; --tw-rotate: 0; --tw-skew-x: 0; --tw-skew-y: 0; --tw-scale-x: 1; --tw-scale-y: 1; --tw-scroll-snap-strictness: proximity; --tw-ring-offset-width: 0px; --tw-ring-offset-color: #fff; --tw-ring-color: rgb(59 130 246 / .5); --tw-ring-offset-shadow: 0 0 #0000; --tw-ring-shadow: 0 0 #0000; --tw-shadow: 0 0 #0000; --tw-shadow-colored: 0 0 #0000; margin-top: 0px; margin-bottom: 0px; padding-inline-start: 0.375em; padding-top: 0px; padding-bottom: 0px; border: 0px solid oklch(var(--foreground-subtler-color));"> The journal covers a broad range of topics related to generative AI, including but not limited to: p]:pt-0 [&>p]:mb-2 [&>p]:my-0" style="box-sizing: border-box; …
publisher: GalaxiaUniverse
language: en
publication name: Journal of Generative Intelligence E: 3117-6429 P: 3117-6437
issn: 3117-6437
items: Scalable Architectures for Training Large Language Models under Resource Constraints
items: Cost-Aware Scheduling and Resource Optimization for Generative AI Pipelines
items: Cloud-Native Architectures for Deploying Generative Intelligence Systems
items: Inference Optimization Techniques for Real-Time Generative AI Applications
items: Distributed Training Frameworks for Large-Scale Generative Models
items: Generative Models for Intelligent Recommendation and Creativity Systems
items: Synthetic Data Generation for Privacy-Preserving Machine Learning
items: Generative Intelligence for Personalized Digital Assistants
items: AI-Assisted Knowledge Creation Systems Using Generative Models
items: Generative AI for Automated Software Code Synthesis and Validation
items: Human-in-the-Loop Approaches for Responsible Generative AI Deployment
items: Safety-Aware Training Objectives for Generative Intelligence
items: Content Authenticity and Watermarking Techniques for Generative Media
items: Explainability Frameworks for Large-Scale Generative Models
items: Bias Detection and Mitigation in Generative AI Systems
items: Energy-Efficient Algorithms for Large-Scale Generative Intelligence
items: Probabilistic Generative Models for Uncertainty-Aware Content Creation
items: Hybrid Generative Architectures Combining Symbolic AI and Deep Learning
items: Diffusion Models for High-Fidelity and Controllable Content Generation
items: Comparative Analysis of Transformer, Diffusion, and GAN-Based Generative Models
items: Fusion Strategies for Vision-Language Generative Systems
items: Multimodal Large Models for Context-Aware Generative Applications
items: Unified Architectures for Multimodal Content Generation
items: Cross-Modal Representation Learning for Generative Intelligence Systems
items: Multimodal Generative Models for Text-Image-Audio Integration
items: Knowledge-Integrated Large Language Models for Reliable Text Generation
items: Continual Learning Frameworks for Long-Lived Generative AI Systems
items: Efficient Fine-Tuning Strategies for Domain-Specific Large Language Models
items: Generative Cognitive Agents in Zero-Shot Environments: Toward Continual Learning and Human-AI Co-Reasoning
items: Ethical Constraints in Generative Intelligence: Guardrails for Bias Control, Digital Safety, and

Scalable Architectures for Training Large Language Models under Resource Constraints
type: item
description: Training large language models (LLMs) at frontier scale requires compute infrastructure accessible to only a small number of well- resourced organisations, creating a concentration of generative AI capability that has significant scientific, economic, and governance implications. Research on scalable training architectures that reduce the computational footprint of high-quality LLM training without proportionate quality degradation is therefore a high- priority direction for democratising access to frontier AI capabilities. This paper proposes the Resource-Constrained LLM Training (RCLT) framework, an integrated system of four architectural and algorithmic techniques -- sparse mixture-of-experts routing with adaptive capacity, gradient checkpointing with selective recomputation, dynamic precision scheduling across training phases, and pipeline parallelism with asynchronous micro-batch processing -- designed to reduce peak GPU memory consumption and wall-clock training time for LLMs in the 7B-70B parameter range. The RCLT framework is evaluated on three LLM training benchmarks across 7B, 13B, and 70B parameter scales on clusters of 8, 32, and 128 A100 GPUs respectively. Results demonstrate that RCLT achieves a 38.4% reduction in peak GPU memory consumption (SD = 3.1%) and a 29.7% reduction in wall-clock training time (SD = 2.8%) relative to standard dense transformer training baselines, while maintaining 97.3% of baseline model quality as measured by perplexity and downstream MMLU performance. The 7B parameter RCLT model trained on a single 8xA100 node achieves performance competitive with dense baseline models requiring 3x the compute budget. The study contributes the RCLT framework specification, open-source implementation, and an empirical characterisation of quality-efficiency trade-offs across scales.
subject: Articles
  topic: section
subject: large language models
  topic: keywords
subject: resource-constrained training
  topic: keywords
subject: mixture of experts
  topic: keywords
subject: gradient checkpointing
  topic: keywords
subject: mixed precision
  topic: keywords
subject: pipeline parallelism
  topic: keywords
subject: compute efficiency
  topic: keywords
subject: LLM scaling
  topic: keywords
creator: Lea Popescu
creator: Marta Horvath
creator: Isabella Novak
rights: Copyright (c) 2024 https://creativecommons.org/licenses/by/4.0
date: 2024-03-20
publication date: 2024-03-20
starting page: 1
ending page: 8
doi: 10.5281/

Cost-Aware Scheduling and Resource Optimization for Generative AI Pipelines
type: item
description: Generative AI pipelines -- multi-stage workflows that chain document ingestion, embedding, retrieval, generation, and post-processing steps -- have become the dominant deployment architecture for enterprise RAG (Retrieval-Augmented Generation) applications, scientific knowledge synthesis, and complex document processing systems. The resource consumption of these pipelines is substantial and highly variable: a single pipeline execution may invoke LLM inference multiple times, trigger vector database queries, perform embedding model inference, and execute document processing operations, with total cost per pipeline execution ranging from fractions of a cent to several dollars depending on input complexity and model choices. Cost-aware scheduling -- the optimisation of when and how pipeline stages are executed based on computational cost, quality requirements, and resource availability -- is a critical but understudied aspect of generative AI operations. This paper proposes the Generative Pipeline Cost Optimisation (GPCO) framework, a systematic methodology for cost-aware scheduling and resource optimisation of generative AI pipelines, comprising five optimisation strategies: adaptive stage skipping (ASS) that bypasses expensive stages when simpler alternatives suffice; quality-cost frontier navigation (QCFN) that selects the minimum-cost pipeline configuration achieving a target quality level; asynchronous stage parallelism (ASP) that overlaps independent pipeline stages for throughput; cost-aware caching (CAC) that prioritises expensive stage results for caching based on cost-amortisation potential; and dynamic resource allocation (DRA) that right-sizes compute allocation for each pipeline stage based on input complexity. GPCO is evaluated on three enterprise RAG pipeline deployments serving 48,000 daily requests over 60 days. GPCO achieves a 54.2% pipeline execution cost reduction (SD = 6.4%) while maintaining 96.8% of baseline output quality, and a 38.4% reduction …
subject: Articles
  topic: section
subject: cost optimisation
  topic: keywords
subject: generative AI pipelines
  topic: keywords
subject: RAG
  topic: keywords
subject: scheduling
  topic: keywords
subject: resource allocation
  topic: keywords
subject: quality-cost trade-off
  topic: keywords
subject: caching
  topic: keywords
subject: enterprise AI
  topic: keywords
creator: Nina Horvath
creator: Erik Jensen
rights: Copyright (c) 2025
date: 2025-10-28
publication date: 2025-10-28
starting page: 25
ending page: 32

Cloud-Native Architectures for Deploying Generative Intelligence Systems
type: item
description: The deployment of large generative AI systems at production scale requires cloud infrastructure architectures that can handle highly variable request loads, provide horizontal scalability, ensure high availability, and integrate with existing enterprise data and security infrastructure -- challenges that differ fundamentally from traditional software deployment due to the compute intensity, memory requirements, and latency sensitivity of generative AI inference. Cloud-native architectures -- systems built on containerisation, microservices, orchestration platforms, and auto-scaling -- provide the infrastructure foundation for this deployment at scale, but standard cloud-native patterns require substantial adaptation to accommodate the specific requirements of generative AI workloads. This paper proposes the Generative AI Cloud-Native Deployment (GACND) framework, a comprehensive reference architecture for deploying large generative AI systems on cloud infrastructure, comprising five architectural layers: a generative model serving layer (GMSL) with GPU-optimised container orchestration; an intelligent request routing layer (IRRL) that matches requests to appropriate model variants based on complexity and latency requirements; an adaptive auto-scaling layer (AASL) that responds to GPU memory pressure and request queue depth; a multi-tenancy and isolation layer (MTIL) that provides secure model serving across multiple tenant organisations; and a monitoring and observability layer (MOL) with generative AI-specific metrics. GACND is evaluated through a 90-day production deployment study on a cloud infrastructure serving 12 enterprise tenants with diverse generative AI workloads, measuring availability, latency, cost efficiency, and security isolation. GACND achieves 99.94% availability (SD = 0.02%), mean TTFT = 318ms (SD = 68ms) at peak load, 42.8% infrastructure cost reduction versus naive GPU reservation, and zero cross-tenant data leakage events. The study contribute…
subject: Articles
  topic: section
subject: cloud-native
  topic: keywords
subject: generative AI
  topic: keywords
subject: deployment architecture
  topic: keywords
subject: Kubernetes
  topic: keywords
subject: auto-scaling
  topic: keywords
subject: multi-tenancy
  topic: keywords
subject: GPU serving
  topic: keywords
subject: microservices
  topic: keywords
creator: Matteo Garcia
creator: Eva Klein
rights: Copyright (c) 2025
date: 2025-10-25
publication date: 2025-10-25
starting page: 17
ending page: 24

Inference Optimization Techniques for Real-Time Generative AI Applications
type: item
description: Real-time generative AI applications -- interactive chatbots, voice assistants, live code completion, real-time translation, and interactive content generation -- impose strict latency requirements (typically < 500ms first-token latency, < 50ms inter-token latency) that current large language models cannot satisfy at full model quality without optimisation. The inference efficiency of generative models is fundamentally constrained by sequential autoregressive decoding -- each token must be generated before the next can begin -- and by the key-value (KV) cache memory requirements that grow linearly with sequence length. This paper proposes the Real-Time Generative Inference (RTGI) optimisation framework, an integrated suite of six inference acceleration techniques designed for sub-500ms end-to-end latency at production quality: continuous batching with dynamic request scheduling (CB-DRS) that maximises GPU utilisation across concurrent requests; speculative decoding with adaptive draft selection (SD-ADS) that uses context-appropriate draft models for maximum acceptance rate; flash attention with sliding window attention (FA-SWA) for memory-efficient long-context inference; quantised model serving with per-layer sensitivity adaptation (QMS-PSA) that applies optimal quantisation per layer; KV cache compression with semantic eviction (KC-SE) that retains semantically important context while compressing the KV cache; and token budget allocation with dynamic stopping (TBA-DS) that predicts and enforces response length to bound latency. RTGI is evaluated on four real-time application benchmarks -- interactive dialogue, live code completion, real-time translation, and voice response -- measuring time-to-first-token (TTFT), throughput (tokens/second), and quality retention. RTGI achieves mean TTFT = 284ms (SD = 42ms) -- meeting the 500ms threshold -- at 96.2% quality retention versus full-model inference, and 4.8x throughput improvement enabling substantially higher concurre…
subject: Articles
  topic: section
subject: inference optimization
  topic: keywords
subject: real-time AI
  topic: keywords
subject: speculative decoding
  topic: keywords
subject: continuous batching
  topic: keywords
subject: KV cache
  topic: keywords
subject: quantisation
  topic: keywords
subject: latency
  topic: keywords
subject: generative AI serving
  topic: keywords
creator: Elena Hansen
creator: Isabella Hansen
creator: Nina Schmidt
rights: Copyright (c) 2025
date: 2025-10-22
publication date: 2025-10-22
starting page: 9
ending page: 16

Distributed Training Frameworks for Large-Scale Generative Models
type: item
description: Training large-scale generative AI models at frontier quality requires distributed compute infrastructure spanning hundreds to thousands of GPUs, with sophisticated parallelism strategies that coordinate computation and communication across this infrastructure with maximal efficiency. The dominant distributed training paradigms -- data parallelism, tensor parallelism, pipeline parallelism, and their combinations -- each impose distinct communication patterns, memory constraints, and load balancing requirements that must be carefully co-designed with the model architecture and hardware topology for optimal training throughput. This paper proposes the Adaptive Distributed Generative Training (ADGT) framework, a systematic methodology for co-designing distributed training strategies with model architecture for large-scale generative model training, integrating four adaptive parallelism components: topology-aware tensor parallelism (TATP) that matches tensor parallelism degree to the hardware interconnect bandwidth topology; dynamic pipeline scheduling (DPS) that adapts micro-batch scheduling to minimise pipeline bubble based on observed computation and communication profiles; heterogeneous expert routing for MoE parallelism (HERMP) that assigns mixture-of-experts routing to heterogeneous GPU capacities; and adaptive gradient communication compression (AGCC) that dynamically selects gradient compression ratios based on gradient noise levels and bandwidth availability. ADGT is evaluated on training runs of 7B, 13B, 34B, and 70B parameter generative models on 32, 64, 128, and 256 GPU clusters with standard InfiniBand networking. ADGT achieves a mean model FLOP utilisation (MFU) of 58.4% (SD = 3.2%) versus 41.6% for the Megatron-LM baseline -- a 40.4% MFU improvement -- and reduces total training wall-clock time by 28.8% at 70B scale on 256 GPUs. The study contributes the ADGT specification, a Training Efficiency Index (TEI), and empirical characterisation of parallelism s…
subject: Articles
  topic: section
subject: distributed training
  topic: keywords
subject: large language models
  topic: keywords
subject: tensor parallelism
  topic: keywords
subject: pipeline parallelism
  topic: keywords
subject: MoE parallelism
  topic: keywords
subject: gradient compression
  topic: keywords
subject: model FLOP utilisation
  topic: keywords
subject: generative AI
  topic: keywords
creator: Anna Novak
creator: Andreas Popescu
creator: Clara Jensen
rights: Copyright (c) 2025
date: 2025-10-20
publication date: 2025-10-20
starting page: 1
ending page: 8

Generative Models for Intelligent Recommendation and Creativity Systems
type: item
description: The integration of large generative AI models into recommendation systems and creative AI applications represents a fundamental architectural shift: from matching users to existing items in a fixed catalogue to generating novel personalised content, creative artefacts, and recommendations that transcend the boundaries of what exists in the training data. Generative recommendation systems -- which generate personalised content, product descriptions, or creative suggestions rather than ranking existing items -- offer the potential to overcome key limitations of collaborative filtering: cold-start problems, catalogue sparsity, and the inability to suggest truly novel content. This paper proposes the Generative Recommendation and Creativity (GRC) framework, a unified architecture that integrates large generative AI capabilities into three distinct application contexts: personalised content recommendation (PCR) that generates customised explanations, summaries, and previews of candidate items tailored to user preferences; creative AI assistance (CAA) that generates novel creative artefacts (music, visual art, writing prompts, design concepts) conditioned on user creative style and context; and serendipitous discovery facilitation (SDF) that deliberately generates recommendations outside user preference boundaries to facilitate novel interest discovery. GRC is evaluated through a 60-day user study with 144 participants across the three application contexts against collaborative filtering and RAG-based recommendation baselines. GRC achieves 24.8% higher user satisfaction than collaborative filtering (4.4/5.0 vs. 3.5/5.0; Cohen d = 2.48), 38.4% higher novel item acceptance rate, and 84.6% creative output acceptance rate in the CAA context. The serendipity dimension -- user acceptance of genuinely unexpected recommendations -- improves from 28.4% to 48.6% under GRC SDF versus collaborative filtering. The study contributes the GRC specification, a Generative Recommendation Qu…
subject: Articles
  topic: section
subject: recommendation systems
  topic: keywords
subject: generative AI
  topic: keywords
subject: creative AI
  topic: keywords
subject: personalised recommendations
  topic: keywords
subject: collaborative filtering
  topic: keywords
subject: serendipity
  topic: keywords
subject: content generation
  topic: keywords
subject: user satisfaction
  topic: keywords
creator: Clara Muller
creator: Sofia Petrov
creator: Hugo Ivanov
rights: Copyright (c) 2025
date: 2025-09-30
publication date: 2025-09-30
starting page: 49
ending page: 56

Synthetic Data Generation for Privacy-Preserving Machine Learning
type: item
description: Synthetic data generation -- the production of artificial datasets that statistically resemble real sensitive data without disclosing individual records -- has emerged as a critical enabling technology for privacy-preserving machine learning in domains where real data collection is constrained by privacy regulations, ethical requirements, or data scarcity. While differentially private synthetic data generation has been an active research area, the application of large generative AI models -- particularly diffusion models, VAEs, and LLMs -- to synthetic data generation has introduced substantially more realistic and statistically faithful synthetic datasets at the cost of increased privacy risk from memorisation and overfitting. This paper proposes the Generative Privacy-Preserving Synthesis (GPPS) framework, a unified methodology for high-fidelity synthetic data generation with formal privacy guarantees across tabular, time-series, text, and image data modalities. GPPS integrates four generation strategies: differentially private variational autoencoder synthesis (DP-VAES) for tabular data; differentially private diffusion model synthesis (DP-DMS) for image data; privacy-preserving LLM-based text synthesis (PP-LLMS) for text data; and federated synthetic generation (FSG) for distributed private data settings. Each strategy provides formal differential privacy (DP) guarantees with specified epsilon budgets. GPPS is evaluated on six benchmark datasets across the four modalities using a unified evaluation framework covering data utility, privacy risk, and downstream ML performance. GPPS achieves mean data utility score of 0.874 (SD = 0.042) at epsilon = 1.0 (strong privacy) -- substantially outperforming prior DP synthesis baselines (0.712, SD = 0.058) -- while maintaining formal DP guarantees verified by the Renyi Differential Privacy accountant. Downstream ML performance on GPPS synthetic data achieves 91.4% of real-data model performance on average. The study contri…
subject: Articles
  topic: section
subject: synthetic data generation
  topic: keywords
subject: differential privacy
  topic: keywords
subject: privacy-preserving ML
  topic: keywords
subject: generative AI
  topic: keywords
subject: diffusion models
  topic: keywords
subject: federated learning
  topic: keywords
subject: data utility
  topic: keywords
subject: GDPR
  topic: keywords
creator: Helena Muller
creator: Pierre Horvath
creator: Elena Dubois
rights: Copyright (c) 2025
date: 2025-09-30
publication date: 2025-09-30
starting page: 41
ending page: 48

Generative Intelligence for Personalized Digital Assistants
type: item
description: Personalized digital assistants -- AI systems that adapt their communication style, knowledge focus, task management, and proactive suggestions to individual user characteristics, preferences, and goals -- represent the most ambitious deployment context for large generative AI models: they must maintain rich, accurate user models over long interaction histories, generate contextually appropriate responses across highly diverse task types, and adapt in real time to changing user needs. This paper proposes the Generative Personalized Assistant (GPA) architecture, a comprehensive framework for building generative AI-powered digital assistants that achieve genuine personalisation through five integrated layers: a deep user model (DUM) that represents user preferences, knowledge states, goals, and interaction patterns across multiple dimensions; a personalised response generator (PRG) that conditions LLM generation on the DUM to produce responses adapted to user expertise, communication style, and context; a proactive task anticipator (PTA) that predicts user needs before explicit requests using temporal pattern analysis; a multi-domain knowledge integrator (MDKI) that maintains user- specific knowledge bases across professional, personal, and educational domains; and a personalisation quality monitor (PQM) that tracks personalisation effectiveness and triggers model updates when preference drift is detected. GPA is evaluated through a 120-day deployment study with 96 participants across three assistant application contexts: professional task management, personal health coaching, and educational tutoring. GPA achieves 4.6/5.0 user satisfaction (SD = 0.3) versus 3.2/5.0 for non-personalised baseline (Cohen d = 5.88); task completion rate improves from 64.8% to 88.4%; and proactive suggestion acceptance rate reaches 72.4% (SD = 6.8%). The study contributes the GPA specification, a Personalisation Effectiveness Index (PEI), and empirical evidence that deep user modelling wi…
subject: Articles
  topic: section
subject: personalised assistants
  topic: keywords
subject: generative AI
  topic: keywords
subject: user modelling
  topic: keywords
subject: proactive assistance
  topic: keywords
subject: digital assistants
  topic: keywords
subject: personalisation
  topic: keywords
subject: large language models
  topic: keywords
subject: human-AI interaction
  topic: keywords
creator: Helena Costa
creator: Erik Kovacs
creator: Pierre Muller
rights: Copyright (c) 2025
date: 2025-09-30
publication date: 2025-09-30
starting page: 33
ending page: 40

AI-Assisted Knowledge Creation Systems Using Generative Models
type: item
description: AI-assisted knowledge creation -- the use of generative AI systems to augment, accelerate, and enrich human knowledge production across scientific, professional, and educational domains -- represents a paradigm shift in the relationship between artificial intelligence and human cognition. While much attention has been devoted to generative AI as a content generator that replaces human writing, the more strategically significant application is as a knowledge co-creation partner that amplifies human expert capacity by handling knowledge synthesis, literature integration, structural organisation, and knowledge gap identification tasks. This paper proposes the Generative Knowledge Creation Assistant (GKCA) framework, a system architecture for AI-assisted knowledge creation that integrates five specialised generative modules: a scientific literature synthesiser (SLS) that generates structured summaries of large document collections; a knowledge gap analyser (KGA) that identifies unexplored research questions from corpus analysis; a hypothesis generator (HG) that proposes novel research hypotheses grounded in existing knowledge; a concept relationship mapper (CRM) that constructs and visualises knowledge graphs from generated syntheses; and a knowledge validation assistant (KVA) that checks generated knowledge claims against scientific literature. GKCA is evaluated through a longitudinal knowledge creation study involving 64 domain experts (researchers, knowledge managers, and educators) who used GKCA across three domains -- biomedical research, technology policy, and environmental science -- over 90 days. GKCA users produce 3.2x more knowledge artefacts per unit time than control users working without AI assistance (p < 0.001, Cohen d = 4.18), with expert-rated quality scores of 4.2/5.0 (SD = 0.4) for GKCA-assisted outputs versus 3.8/5.0 (SD = 0.6) for unassisted outputs (p < 0.01). The study contributes the GKCA specification, a Knowledge Creation Quality Index (KCQI), …
subject: Articles
  topic: section
subject: knowledge creation
  topic: keywords
subject: generative AI
  topic: keywords
subject: AI-assisted research
  topic: keywords
subject: scientific synthesis
  topic: keywords
subject: knowledge gaps
  topic: keywords
subject: hypothesis generation
  topic: keywords
subject: knowledge graphs
  topic: keywords
subject: expert augmentation
  topic: keywords
creator: Oscar Horvath
creator: Amelia Jensen
rights: Copyright (c) 2025
date: 2025-09-28
publication date: 2025-09-28
starting page: 25
ending page: 32

Generative AI for Automated Software Code Synthesis and Validation
type: item
description: Automated code synthesis -- the generation of correct, efficient, and secure software code from natural language specifications -- represents one of the highest-value practical applications of large generative AI models, with the potential to substantially accelerate software development productivity and reduce defect rates. While LLMs have demonstrated impressive code generation capability (HumanEval pass@1 scores exceeding 60% for state-of- the-art models), the deployment of AI-generated code in production software systems requires not only functional correctness but security soundness, computational efficiency, and maintainability -- quality dimensions that standard benchmarks inadequately capture. This paper proposes the Generative Code Synthesis and Validation (GCSV) framework, an end-to-end pipeline for AI-driven code generation, multi-dimensional validation, and iterative refinement that integrates four specialised components: a specification-aware code generator (SACG) that conditions LLM code generation on formal input-output specifications; a multi-dimensional code validator (MCV) that evaluates generated code on functional correctness, security, performance, and maintainability; a feedback-driven refinement controller (FDRC) that iteratively improves code based on validator feedback; and a code quality certifier (CQC) that issues formal quality certificates for code meeting all validation thresholds. GCSV is evaluated on three programming benchmark suites -- HumanEval, MBPP, and a novel Security-Performance-Maintainability benchmark (SPM-Bench) -- at four model scales (7B, 13B, 34B, 70B parameters). GCSV achieves HumanEval pass@1 = 71.8% (SD = 1.4%) at 7B scale -- a 48.4% improvement over naive LLM baseline -- and SPM-Bench composite quality score = 82.4% (SD = 2.8%) versus 54.6% for baseline. Security defect rate is reduced by 68.2% and computational efficiency improves by 24.6% through the FDRC refinement cycle. The study contributes the GCSV specificat…
subject: Articles
  topic: section
subject: code synthesis
  topic: keywords
subject: generative AI
  topic: keywords
subject: program synthesis
  topic: keywords
subject: code validation
  topic: keywords
subject: security
  topic: keywords
subject: LLM
  topic: keywords
subject: software quality
  topic: keywords
subject: automated programming
  topic: keywords
creator: Marta Garcia
rights: Copyright (c) 2025
date: 2025-09-25
publication date: 2025-09-25
starting page: 17
ending page: 24

Human-in-the-Loop Approaches for Responsible Generative AI Deployment
type: item
description: Human-in-the-loop (HITL) systems -- architectures that maintain meaningful human oversight and intervention capability in AI-assisted processes -- are a central governance requirement for high-stakes generative AI deployment under the EU AI Act (2024) and a fundamental principle of responsible AI frameworks. However, the practical design of effective HITL architectures for generative AI presents distinct challenges compared to HITL systems for classification-based AI: the open-ended output space makes exhaustive human review infeasible at scale; the fluency and confidence of generative outputs can undermine human critical evaluation; and the high throughput requirements of deployed generative systems create time pressure that degrades human review quality. This paper proposes the Generative AI Human Oversight (GAHO) framework, a systematic methodology for designing, implementing, and evaluating HITL systems for generative AI deployment across four oversight models: full review (FR), risk-stratified review (RSR), spot-check audit (SCA), and algorithmic-human collaborative review (AHCR). GAHO integrates a risk stratification engine (RSE) that routes outputs to appropriate oversight levels based on uncertainty, context, and domain risk; a human reviewer support system (HRSS) that provides reviewers with GEF explainability, uncertainty estimates, and bias indicators; and a review quality monitoring system (RQMS) that tracks reviewer performance and flags review degradation. GAHO is evaluated through a controlled deployment study across three high-stakes generative AI applications: clinical note generation, legal document drafting, and financial report generation, with 128 human reviewers over 60 days. GAHO RSR achieves 94.2% harmful output detection rate (SD = 3.1%) at 42.8% review cost reduction relative to full review, while AHCR achieves 96.8% detection at 61.4% cost reduction. Reviewer support tools (HRSS) improve detection accuracy by 18.4pp over unsupported review…
subject: Articles
  topic: section
subject: human-in-the-loop
  topic: keywords
subject: responsible AI
  topic: keywords
subject: generative AI
  topic: keywords
subject: human oversight
  topic: keywords
subject: risk stratification
  topic: keywords
subject: reviewer support
  topic: keywords
subject: EU AI Act
  topic: keywords
subject: deployment
  topic: keywords
creator: Isabella Hansen
rights: Copyright (c) 2025
date: 2025-09-22
publication date: 2025-09-22
starting page: 9
ending page: 16

Safety-Aware Training Objectives for Generative Intelligence
type: item
description: Large generative AI systems trained on web-scale corpora absorb not only the beneficial knowledge and capabilities of human culture but also its harmful content -- instructions for dangerous activities, dehumanising language, deceptive rhetoric, and content that violates fundamental ethical norms. Standard RLHF-based safety alignment addresses harmful outputs post-training through preference learning but does not modify the training objectives that determine what capabilities the model acquires during pre-training. This paper proposes the Safety-Aware Generative Training (SAGT) framework, a set of modified pre-training and fine-tuning objectives that integrate safety considerations directly into the generative learning process rather than addressing them solely through post-training alignment. SAGT comprises four training objective modifications: harm-weighted token loss (HWTL) that downweights the gradient contribution of harmful training tokens; capability-safety decoupling (CSD) that separates safety-relevant capability learning into a controllable parameter subspace; safety-consistent pretraining data filtering (SCPDF) that applies automated harm classifiers to curate training data before pre-training; and constitutional pre-training constraints (CPC) that enforce constitutional AI principles as soft constraints on the pre-training objective. SAGT is evaluated on safety benchmarks (TruthfulQA, HarmBench, BBQ bias), capability benchmarks (MMLU, HumanEval), and alignment tax (the quality degradation from safety training). Results demonstrate that SAGT reduces harmful output rates by 61.4% (SD = 5.8%) on HarmBench while retaining 96.2% of baseline capability on MMLU and HumanEval -- substantially improving the safety-capability trade-off compared to post-training RLHF alone. The alignment tax for SAGT is 3.8% (vs. 12.4% for equivalent RLHF-only safety), confirming that safety-at-training-time is more capability-efficient than safety-at-alignment-time. The study con…
subject: Articles
  topic: section
subject: safety-aware training
  topic: keywords
subject: generative AI
  topic: keywords
subject: alignment
  topic: keywords
subject: RLHF
  topic: keywords
subject: harmful content
  topic: keywords
subject: constitutional AI
  topic: keywords
subject: training objectives
  topic: keywords
subject: safety-capability trade-off
  topic: keywords
creator: Clara Moreau
rights: Copyright (c) 2025
date: 2025-09-20
publication date: 2025-09-20
starting page: 1
ending page: 8

Content Authenticity and Watermarking Techniques for Generative Media
type: item
description: The rapid democratisation of high-quality generative AI -- text, image, audio, and video synthesis at human-indistinguishable quality -- has created a critical societal challenge: the ability to distinguish authentic human-created content from AI-generated synthetic media is becoming increasingly difficult, with significant implications for information integrity, electoral processes, legal systems, and public trust. Watermarking and content authenticity mechanisms -- techniques for embedding verifiable provenance signals in AI-generated content -- have emerged as primary technical responses to this challenge, but existing approaches are fragmented across modalities, vulnerable to removal attacks, and lack standardised evaluation methodologies. This paper proposes the Generative Media Authenticity (GMA) framework, a unified approach to content watermarking and authenticity verification across text, image, audio, and video modalities, comprising four watermarking techniques: semantic watermarking for text (SWT) that embeds verifiable signals in token selection patterns; spectral watermarking for images (SpWI) that embeds imperceptible frequency- domain signals; psychoacoustic watermarking for audio (PWA) that uses auditory masking thresholds; and temporal-spatial watermarking for video (TSWV) that coordinates frame-level and motion-level signals. GMA is evaluated on watermark robustness (resistance to removal attacks), imperceptibility (signal quality degradation), and detection accuracy across four generative AI systems. GMA achieves mean watermark detection accuracy of 97.4% (SD = 1.8%) after 12 attack types including compression, paraphrasing, and adversarial removal, while maintaining 98.6% of baseline generation quality (imperceptibility). The false positive rate (human-created content incorrectly flagged as AI-generated) is 0.8% -- meeting the threshold required for deployment in legal and forensic contexts. The study contributes the GMA specification, a Content…
subject: Articles
  topic: section
subject: watermarking
  topic: keywords
subject: content authenticity
  topic: keywords
subject: generative AI
  topic: keywords
subject: synthetic media
  topic: keywords
subject: deepfake detection
  topic: keywords
subject: provenance
  topic: keywords
subject: information integrity
  topic: keywords
subject: EU AI Act
  topic: keywords
creator: Marco Costa
creator: Lea Garcia
rights: Copyright (c) 2025
date: 2025-06-25
publication date: 2025-06-25
starting page: 41
ending page: 48

Explainability Frameworks for Large-Scale Generative Models
type: item
description: Explainability -- the ability to provide human-understandable accounts of model behaviour, generation decisions, and output provenance -- is a critical requirement for responsible deployment of large-scale generative AI systems in regulated domains and high-stakes applications. While explainability for classification and regression models has a mature literature (LIME, SHAP, attention visualisation), the extension of explainability methods to large-scale generative models presents unique challenges: the open-ended output space, the autoregressive generation process, the multi-layer attention architecture, and the trillion-parameter scale all complicate the application of standard explainability techniques. This paper proposes the Generative Explainability Framework (GEF), a comprehensive methodology for explaining large-scale generative model behaviour across four explanation types: token attribution (which input tokens most influenced each generated token), training data attribution (which training examples most influenced the generation), concept-level explanation (which high-level concepts drove generation choices), and counterfactual explanation (what minimal input changes would produce different outputs). GEF integrates four corresponding explanation methods: Integrated Gradients for LLMs (IGLLM), influence function approximation (IFA), concept activation vectors for generation (CAVG), and generation counterfactual search (GCS). GEF is evaluated on explanation faithfulness, completeness, and user comprehension across three LLM applications: medical diagnosis explanation, legal document drafting, and code generation. GEF achieves 84.2% explanation faithfulness (SD = 3.8%) -- the degree to which explanations accurately reflect model behaviour -- and 71.6% user comprehension accuracy (SD = 5.4%) in a user study with 96 domain professionals. The study contributes the GEF specification, a Generative Explanation Quality (GEQ) evaluation framework, and empirical evide…
subject: Articles
  topic: section
subject: explainability
  topic: keywords
subject: large language models
  topic: keywords
subject: generative AI
  topic: keywords
subject: interpretability
  topic: keywords
subject: integrated gradients
  topic: keywords
subject: influence functions
  topic: keywords
subject: concept activation vectors
  topic: keywords
subject: counterfactual explanation
  topic: keywords
creator: Erik Ivanov
creator: Pierre Horvath
rights: Copyright (c) 2025
date: 2025-06-25
publication date: 2025-06-25
starting page: 33
ending page: 40

Bias Detection and Mitigation in Generative AI Systems
type: item
description: Generative AI systems -- large language models, image generators, and multimodal models -- encode and amplify societal biases present in their training data, producing outputs that systematically disadvantage or misrepresent individuals on the basis of protected characteristics including gender, race, ethnicity, religion, age, and disability. Unlike bias in classification-based AI where individual decisions can be audited, generative AI bias manifests across open-ended output spaces that are difficult to exhaustively test and that interact with user prompts in complex ways to produce varying bias profiles. This paper proposes the Generative AI Bias Evaluation and Mitigation (GABEM) framework, a systematic methodology for detecting, quantifying, and mitigating bias in generative AI systems across five bias dimensions: representational bias, stereotyping bias, sentiment bias, opportunity bias, and intersectional bias. GABEM integrates three bias detection methods -- distributional analysis (DA), counterfactual probing (CP), and generative bias audit (GBA) -- with three mitigation strategies -- counterfactual data augmentation (CDA), bias-aware reinforcement learning from human feedback (BA-RLHF), and debiased decoding constraints (DDC). GABEM is evaluated on three generative AI systems: a text generation LLM (LLaMA-2-7B), a text-to-image diffusion model (Stable Diffusion XL), and a multimodal generation model (LLaVA-1.5-13B), using a comprehensive bias evaluation suite of 12 benchmarks across the five bias dimensions. Results demonstrate that the GABEM mitigation suite reduces mean bias scores by 48.4% (SD = 6.2%) while maintaining 94.6% of baseline generation quality. Intersectional bias -- the compounded bias affecting individuals at multiple protected characteristic intersections -- shows the largest mitigation benefit (62.8% reduction) and was previously unaddressed in generative AI bias literature. The study contributes the GABEM framework, a Generative Bias Scor…
subject: Articles
  topic: section
subject: bias detection
  topic: keywords
subject: bias mitigation
  topic: keywords
subject: generative AI
  topic: keywords
subject: fairness
  topic: keywords
subject: large language models
  topic: keywords
subject: intersectional bias
  topic: keywords
subject: counterfactual probing
  topic: keywords
subject: responsible AI
  topic: keywords
creator: Lukas Dubois
creator: Lea Petrov
rights: Copyright (c) 2025
date: 2025-06-20
publication date: 2025-06-20
starting page: 25
ending page: 32

Energy-Efficient Algorithms for Large-Scale Generative Intelligence
type: item
description: The energy consumption of large-scale generative AI systems has emerged as a critical sustainability concern: training a frontier large language model requires an estimated 100-1000 MWh of electricity, and inference at scale for widely-deployed generative systems can consume comparable cumulative energy through continuous operation. The environmental and economic costs of this energy consumption -- measured in carbon emissions, water cooling requirements, and infrastructure cost -- are increasingly recognised as constraints on responsible and equitable AI development. This paper proposes the Energy-Efficient Generative Intelligence (EEGI) framework, an integrated suite of five algorithmic techniques for reducing the energy consumption of large-scale generative AI systems at both training and inference time: adaptive computation skipping (ACS) that dynamically skips transformer layers for inputs below a complexity threshold; speculative decoding with energy-aware draft models (SD-EA) that uses smaller draft models calibrated for energy efficiency rather than accuracy alone; batching optimisation with dynamic power management (BO-DPM) that co- optimises inference batching and GPU power states; token recycling and reuse (TRR) that caches and reuses attention computations for repeated or similar inputs; and quantisation-aware knowledge distillation (QAKD) that produces smaller, quantised student models retaining generation quality. The EEGI framework is evaluated through energy consumption measurement on a production LLM inference cluster (128 A100 GPUs) running LLaMA-2-70B over 30 days. EEGI achieves a 52.4% reduction in inference energy consumption (kWh per 1M tokens; SD = 4.2%) while maintaining 96.8% of baseline generation quality (MMLU + human evaluation). Training-time QAKD reduces energy by 34.6% relative to baseline training at the same model quality level. The study contributes the EEGI specification, an Energy-Quality Index (EQI), and empirical evidence that c…
subject: Articles
  topic: section
subject: energy efficiency
  topic: keywords
subject: generative AI
  topic: keywords
subject: large language models
  topic: keywords
subject: speculative decoding
  topic: keywords
subject: knowledge distillation
  topic: keywords
subject: quantisation
  topic: keywords
subject: sustainable AI
  topic: keywords
subject: inference optimisation
  topic: keywords
creator: Elena Silva
creator: Lukas Rossi
rights: Copyright (c) 2025
date: 2025-06-15
publication date: 2025-06-15
starting page: 17
ending page: 24

Probabilistic Generative Models for Uncertainty-Aware Content Creation
type: item
description: Generative AI systems are increasingly deployed in high-stakes applications where the uncertainty of generated outputs is as important as their quality: a medical imaging system that generates plausible-looking but uncertain diagnoses, or a legal document assistant that produces confident-sounding but factually unreliable text, can cause harm precisely because the system fails to communicate its epistemic limitations to users. Uncertainty-aware content generation -- the principled quantification and communication of model uncertainty alongside generated content -- has received limited systematic attention despite its practical importance. This paper proposes the Uncertainty-Aware Generative (UAG) framework, a methodology for integrating epistemic and aleatoric uncertainty quantification into large generative models across text, image, and code generation domains. UAG comprises three integrated components: a Bayesian uncertainty estimator (BUE) that provides calibrated uncertainty estimates for LLM token predictions through Monte Carlo dropout ensembles; a semantic uncertainty propagator (SUP) that aggregates token-level uncertainties into claim-level and document-level uncertainty representations; and an uncertainty-adaptive generation controller (UAGC) that modulates generation behaviour -- triggering abstention, caveat insertion, or alternative generation -- based on uncertainty thresholds. UAG is evaluated on calibration quality, uncertainty communication effectiveness, and generation quality across four domains. UAG achieves a 34.8% improvement in uncertainty calibration (Expected Calibration Error reduction from 0.148 to 0.097) and a 28.6% improvement in user trust calibration accuracy (users correctly identifying high-uncertainty outputs) relative to standard LLM baselines. The study contributes the UAG specification, a Generative Uncertainty Quality (GUQ) evaluation framework, and empirical evidence for the practical value of explicit uncertainty communicatio…
subject: Articles
  topic: section
subject: uncertainty quantification
  topic: keywords
subject: generative AI
  topic: keywords
subject: Bayesian deep learning
  topic: keywords
subject: calibration
  topic: keywords
subject: epistemic uncertainty
  topic: keywords
subject: aleatoric uncertainty
  topic: keywords
subject: uncertainty-aware generation
  topic: keywords
subject: responsible AI
  topic: keywords
creator: Clara Petrov
creator: Elena Hansen
rights: Copyright (c) 2025
date: 2025-06-25
publication date: 2025-06-25
starting page: 9
ending page: 16

Hybrid Generative Architectures Combining Symbolic AI and Deep Learning
type: item
description: The dichotomy between symbolic AI -- with its strengths in logical reasoning, constraint satisfaction, and interpretability -- and deep learning -- with its strengths in perceptual pattern recognition, flexible representation, and scalable learning -- has historically produced two largely separate research communities and system architectures. Hybrid approaches that integrate both paradigms have long been advocated as a path to systems that combine the statistical generalisation of deep learning with the structured reasoning of symbolic AI, but practical integration architectures that achieve this combination at scale for generative tasks remain scarce. This paper proposes the Neurosymbolic Generative Architecture (NGA), a hybrid framework that integrates a large language model backbone with three symbolic reasoning modules: a formal logic verifier (FLV) that checks LLM-generated outputs against first-order logic constraints; a constraint-guided generation controller (CGC) that steers LLM decoding toward constraint-satisfying outputs; and a knowledge graph reasoning engine (KGRE) that augments LLM generation with structured symbolic reasoning over factual knowledge. The NGA is evaluated on four hybrid reasoning-generation benchmarks: logical constraint satisfaction in text generation, structured knowledge synthesis, formal specification-to-code generation, and mathematical proof sketch generation. NGA achieves a 42.6% improvement in constraint satisfaction rate (SD = 4.8%) and a 28.4% improvement in logical consistency (SD = 3.9%) relative to pure LLM baselines, while maintaining 94.8% of LLM fluency. The study contributes the NGA specification, a hybrid reasoning-generation evaluation suite, and empirical evidence that neurosymbolic integration substantially improves constrained and logically consistent generative AI outputs.
subject: Articles
  topic: section
subject: neurosymbolic AI
  topic: keywords
subject: hybrid architectures
  topic: keywords
subject: symbolic reasoning
  topic: keywords
subject: large language models
  topic: keywords
subject: constraint satisfaction
  topic: keywords
subject: knowledge graphs
  topic: keywords
subject: formal verification
  topic: keywords
subject: generative AI
  topic: keywords
creator: Andreas Moreau
creator: Isabella Silva
rights: Copyright (c) 2025
date: 2025-06-20
publication date: 2025-06-20
starting page: 1
ending page: 8

Diffusion Models for High-Fidelity and Controllable Content Generation
type: item
description: Diffusion models have established themselves as the dominant paradigm for high-fidelity visual content generation, achieving state-of-the-art quality in image and video synthesis. However, achieving high fidelity and precise controllability simultaneously remains a central challenge: the stochastic nature of diffusion sampling that enables high diversity and quality is inherently at tension with the deterministic control required for precise content specification. This paper proposes the Fidelity-Control Diffusion (FCD) framework, a unified approach to simultaneously optimising generation fidelity and controllability in diffusion models through three novel mechanisms: adaptive classifier- free guidance (ACFG) that dynamically adjusts guidance strength based on semantic content difficulty; hierarchical conditioning injection (HCI) that provides conditioning signals at multiple diffusion timestep ranges to enable both coarse-grained structural control and fine-grained detail control; and semantic consistency regularisation (SCR) that enforces semantic alignment between conditioning signals and generated outputs through a consistency loss during fine-tuning. The FCD framework is evaluated on image generation (text-to-image, layout-to- image, semantic segmentation-to-image) and video generation (text-to- video, pose-to-video) benchmarks. FCD achieves a 28.4% improvement in controllability precision (CLIP-score improvement = 0.082) while maintaining 98.1% of baseline generation fidelity (FID increase from 14.2 to 14.5) -- substantially improving the fidelity-controllability trade-off compared to standard CFG approaches. On layout-to-image generation, FCD achieves 91.4% object placement accuracy (SD = 2.1%), a 24.8% improvement over ControlNet. The study contributes the FCD framework, an ACFG scheduling algorithm, and a Fidelity-Controllability Trade-off (FCT) evaluation benchmark.
subject: Articles
  topic: section
subject: diffusion models
  topic: keywords
subject: controllable generation
  topic: keywords
subject: classifier-free guidance
  topic: keywords
subject: high-fidelity generation
  topic: keywords
subject: layout-to-image
  topic: keywords
subject: ControlNet
  topic: keywords
subject: hierarchical conditioning
  topic: keywords
subject: text-to-image
  topic: keywords
creator: Helena Costa
rights: Copyright (c) 2025
date: 2025-03-18
publication date: 2025-03-18
starting page: 33
ending page: 40

Comparative Analysis of Transformer, Diffusion, and GAN-Based Generative Models
type: item
description: The generative AI landscape is currently defined by three dominant paradigmatic approaches -- autoregressive transformer models, diffusion models, and generative adversarial networks -- each with distinct training objectives, architectural principles, and generation characteristics that make them differentially suitable for different generation tasks, data modalities, and deployment contexts. Despite the substantial literature on each paradigm individually, a rigorous cross-paradigm comparative evaluation that assesses all three approaches on a common set of benchmarks, quality dimensions, and efficiency criteria remains absent, making it difficult for practitioners to make principled architecture selection decisions. This paper presents the first comprehensive cross-paradigm comparative evaluation of transformer, diffusion, and GAN-based generative models across eight generation domains -- image synthesis, text generation, audio synthesis, video synthesis, molecular generation, code synthesis, 3D object generation, and time-series forecasting -- using a unified evaluation framework covering six quality dimensions: sample quality, diversity, training stability, inference efficiency, controllability, and compositional generalisation. Results across 24 benchmark comparisons reveal that no single paradigm dominates across all domains and dimensions: diffusion models achieve the highest image and audio sample quality (FID = 14.2 for image, MOS = 4.6 for audio); autoregressive transformers achieve superior text quality (perplexity), code synthesis (HumanEval pass@1 = 52.4%), and compositional generalisation (42.6% C-CME R@1); GANs achieve the highest inference speed (6.8x faster than diffusion, 3.2x faster than transformers) at competitive image quality. The paper contributes a cross-paradigm evaluation framework, a domain-paradigm suitability matrix, and empirical evidence supporting a complementarity rather than competition view of generative AI paradigms.
subject: Articles
  topic: section
subject: generative models
  topic: keywords
subject: transformers
  topic: keywords
subject: diffusion models
  topic: keywords
subject: GANs
  topic: keywords
subject: comparative evaluation
  topic: keywords
subject: generation quality
  topic: keywords
subject: inference efficiency
  topic: keywords
subject: paradigm comparison
  topic: keywords
creator: Marco Silva
creator: Matteo Horvath
rights: Copyright (c) 2025
date: 2025-03-20
publication date: 2025-03-20
starting page: 25
ending page: 32

Fusion Strategies for Vision-Language Generative Systems
type: item
description: Vision-language generative systems -- models that jointly process visual and textual inputs to produce coherent multimodal or unimodal outputs -- are a central class of multimodal AI systems with diverse applications in image captioning, visual question answering, text-to-image generation, and visual dialogue. The fusion strategy -- the architectural mechanism by which visual and textual representations are combined -- is a critical design decision that substantially impacts generation quality, cross-modal coherence, and computational efficiency. While individual fusion approaches have been extensively studied, a systematic comparative evaluation of fusion strategies across multiple generation tasks, model scales, and evaluation dimensions remains absent. This paper presents a comprehensive comparative study of seven vision-language fusion strategies -- early fusion, late fusion, cross-attention fusion, query-based fusion (Q-Former), gated fusion, mixture-of-modalities fusion, and hierarchical dual-stream fusion -- evaluated across five vision-language generation benchmarks at three model scales (3B, 7B, 13B). Results demonstrate significant fusion strategy effects across tasks: cross-attention fusion achieves best visual question answering performance (VQAv2 accuracy = 82.4%); Q-Former fusion achieves best image captioning (CIDEr = 148.6); hierarchical dual-stream achieves best text-to-image generation (FID = 19.2); and early fusion achieves best computational efficiency (training time = 68.4% of cross-attention baseline). The study identifies a generation task-fusion strategy alignment principle: optimal fusion strategy depends on whether the task requires visual grounding (favouring cross-attention/Q-Former) or generation independence from vision (favouring early/late fusion). The paper contributes a fusion strategy taxonomy, a comprehensive benchmark evaluation suite, and design guidelines for vision- language generative system architects.
subject: Articles
  topic: section
subject: vision-language models
  topic: keywords
subject: fusion strategies
  topic: keywords
subject: multimodal generation
  topic: keywords
subject: cross-attention
  topic: keywords
subject: Q-Former
  topic: keywords
subject: visual grounding
  topic: keywords
subject: image captioning
  topic: keywords
subject: visual question answering
  topic: keywords
creator: Daniel Popescu
creator: Sofia Popescu
rights: Copyright (c) 2025
date: 2025-03-25
publication date: 2025-03-25
starting page: 17
ending page: 24

Multimodal Large Models for Context-Aware Generative Applications
type: item
description: Context-aware generative applications -- systems that adapt their generated outputs based on rich contextual signals including user history, environmental conditions, task state, and multimodal situational cues -- represent a critical evolution beyond single-turn prompt-response generation. While large language models and multimodal models have demonstrated impressive generation quality in single- turn settings, their adaptation to dynamic, long-horizon contexts remains limited by short context windows, poor long-term memory, and the inability to integrate heterogeneous contextual signals from diverse modalities continuously over application sessions. This paper proposes the Context-Aware Multimodal Generation (CAMG) framework, an architecture and training methodology for large multimodal models that maintain and leverage rich contextual representations across extended application sessions. CAMG integrates four contextual mechanisms: a hierarchical context memory that compresses and retains long-horizon interaction history; a multimodal context encoder that integrates situational signals from text, image, and structured data sources; a context-conditioned generation head that adapts generation style, content, and format based on inferred user preferences and task state; and a context consistency verifier that maintains semantic coherence between generated outputs across session turns. CAMG is evaluated through a contextual generation quality study involving 186 participants using three context-aware application prototypes -- a personalised learning assistant, an adaptive creative writing tool, and a context-aware medical information navigator -- over 30-day deployment periods. CAMG achieves a 41.8% improvement in contextual relevance scores (SD = 5.2%) and a 34.6% improvement in generation consistency (SD = 4.8%) relative to single-turn LLM baselines. User satisfaction ratings improve from 3.4/5.0 to 4.6/5.0 (p < 0.001, Cohen d = 2.84). The study contributes the CAM…
subject: Articles
  topic: section
subject: context-aware generation
  topic: keywords
subject: multimodal large models
  topic: keywords
subject: long-horizon context
  topic: keywords
subject: context memory
  topic: keywords
subject: personalised generation
  topic: keywords
subject: generative applications
  topic: keywords
subject: large language models
  topic: keywords
subject: adaptive generation
  topic: keywords
creator: Marta Schmidt
creator: Amelia Jensen
rights: Copyright (c) 2025
date: 2025-03-28
publication date: 2025-03-28
starting page: 9
ending page: 16

Unified Architectures for Multimodal Content Generation
type: item
description: The proliferation of specialised generative architectures -- distinct models for text, image, audio, video, and code generation -- has produced impressive per-modality performance but fragmented the generative AI landscape into a collection of task-specific systems that require separate deployment, maintenance, and orchestration overhead. Unified architectures -- single model systems capable of generating high-quality content across multiple modalities without per-modality specialisation -- represent the next frontier in generative intelligence but remain significantly behind specialist models in output quality. This paper proposes the Universal Content Generator (UCG), a unified autoregressive architecture for high-quality multimodal content generation based on a single transformer backbone with modality-adaptive tokenisation, shared attention with modality-aware positional encoding, and a mixture-of-decoders output head that routes generation to modality-specific decoder networks while sharing the primary attention stack. UCG supports five generation modes: text, image (512x512), audio (speech and music), code, and video (4-second clips at 16fps). The UCG architecture is trained using a curriculum that progresses from unimodal pre-training through bimodal alignment to full five-modality joint training on a 1.8T token multimodal corpus. UCG evaluation on 15 generation benchmarks across all five modalities demonstrates that UCG closes 84.2% of the quality gap between unified and specialist models on average, with text generation matching GPT-3.5-level performance, image generation achieving FID = 22.1 (competitive with mid-tier specialist models), and code generation achieving HumanEval pass@1 = 48.4%. UCG introduces a 31.7% parameter reduction versus the ensemble of specialist models required for equivalent modality coverage. The study contributes the UCG architecture, a multimodal curriculum training methodology, and a Unified Generation Quality (UGQ) evaluation s…
subject: Articles
  topic: section
subject: unified architecture
  topic: keywords
subject: multimodal generation
  topic: keywords
subject: autoregressive transformer
  topic: keywords
subject: modality-adaptive tokenisation
  topic: keywords
subject: mixture of decoders
  topic: keywords
subject: curriculum training
  topic: keywords
subject: generative intelligence
  topic: keywords
subject: content generation
  topic: keywords
creator: Laura Nowak
creator: Anna Petrov
rights: Copyright (c) 2025
date: 2025-03-22
publication date: 2025-03-22
starting page: 1
ending page: 8

Cross-Modal Representation Learning for Generative Intelligence Systems
type: item
description: Cross-modal representation learning -- the development of shared latent representations that capture semantic correspondences across different data modalities -- is a foundational capability for generative intelligence systems that must reason and generate coherently across text, image, audio, and other modality spaces. Despite substantial progress in bimodal alignment (CLIP for text-image, CLAP for text-audio) and emerging trimodal approaches, the theoretical foundations and systematic evaluation of cross-modal representation quality remain underdeveloped relative to the engineering advances. This paper proposes the Cross-Modal Representation Quality (CMRQ) framework, a theoretical and empirical framework for evaluating the quality of cross-modal representations along five dimensions: semantic alignment, structural preservation, compositional generalization, cross-modal transfer efficiency, and generation coherence. The CMRQ framework is instantiated through a novel Hierarchical Cross-Modal Contrastive (HCMC) learning objective that extends standard contrastive alignment to three hierarchical levels of semantic granularity -- instance, category, and attribute -- enabling richer, more compositionally structured cross-modal representations. HCMC is evaluated on eight cross-modal benchmarks spanning text-image, text-audio, and image-audio modality pairs, and compared against CLIP, CLAP, and ImageBind baselines. HCMC achieves state-of-the-art cross-modal retrieval performance on six of eight benchmarks, with mean R@1 improvement of 8.4 percentage points over CLIP and 11.2 points over ImageBind. Compositional generalisation performance -- evaluated on novel attribute-object combinations not seen during training -- improves by 24.6% over CLIP, demonstrating that hierarchical contrastive learning produces structurally richer cross-modal representations. The study contributes the CMRQ evaluation framework, the HCMC learning objective, and a compositional cross-modal evalua…
subject: Articles
  topic: section
subject: cross-modal representation learning
  topic: keywords
subject: contrastive learning
  topic: keywords
subject: multimodal
  topic: keywords
subject: hierarchical alignment
  topic: keywords
subject: compositional generalisation
  topic: keywords
subject: CLIP
  topic: keywords
subject: generative intelligence
  topic: keywords
subject: semantic alignment
  topic: keywords
creator: Ivan Novak
creator: Hugo Horvath
creator: Eva Garcia
rights: Copyright (c) 2024
date: 2024-03-28
publication date: 2024-03-28
starting page: 41
ending page: 48

Multimodal Generative Models for Text-Image-Audio Integration
type: item
description: Generative AI has advanced rapidly in individual modality domains -- text generation through large language models, image synthesis through diffusion models, audio generation through neural codec language models -- but the integration of all three modalities within a unified generative architecture capable of cross-modal conditioning, joint generation, and coherent multimodal output remains an open and technically challenging problem. This paper proposes the Trimodal Generative Integration (TGI) architecture, a unified framework for text-image-audio joint generation and cross-modal conditioning based on a shared latent space representation with modality- specific encoders, a cross-modal attention transformer core, and modality- specific decoders. TGI supports four generation modes: text-conditioned image-audio generation (given a text description, generate coherent image and audio); image-conditioned text-audio generation; audio-conditioned text-image generation; and unconditioned trimodal joint generation. The TGI architecture is trained on a curated trimodal dataset of 2.1M aligned text-image-audio triplets (TIA-2M) constructed from captioned video content with automatic audio transcription and alignment. Evaluation on four multimodal generation benchmarks demonstrates that TGI achieves state-of-the-art cross-modal coherence scores: cross-modal semantic alignment (CLIP-Audio similarity) of 0.74 (SD = 0.04) versus 0.61 for best competing bimodal system; image generation quality (FID = 18.4, SD = 2.1) competitive with specialist text-to-image models; and audio generation naturalness (MOS = 4.2/5.0, SD = 0.3) competitive with specialist TTS systems. The study contributes the TGI architecture, the TIA-2M trimodal dataset, and a Trimodal Generation Quality (TGQ) evaluation suite covering seven cross-modal coherence and generation quality dimensions.
subject: Articles
  topic: section
subject: multimodal generation
  topic: keywords
subject: text-image-audio
  topic: keywords
subject: cross-modal conditioning
  topic: keywords
subject: diffusion models
  topic: keywords
subject: large language models
  topic: keywords
subject: joint generation
  topic: keywords
subject: trimodal architecture
  topic: keywords
subject: shared latent space
  topic: keywords
creator: Sofia Lindberg
creator: Anna Hansen
creator: Anna Bianchi
rights: Copyright (c) 2024
date: 2024-03-30
publication date: 2024-03-30
starting page: 33
ending page: 40

Knowledge-Integrated Large Language Models for Reliable Text Generation
type: item
description: Large language models generate fluent and contextually coherent text but remain prone to hallucination -- the generation of plausible-sounding but factually incorrect content -- a fundamental reliability limitation that constrains their deployment in knowledge-intensive applications where factual accuracy is critical. The hallucination problem arises from the tension between the generative objective (predicting plausible next tokens) and the factual accuracy objective (grounding claims in verifiable knowledge), which are not aligned during standard language model training. This paper proposes the Knowledge-Integrated LLM (KILLM) architecture, a framework that integrates structured knowledge graph (KG) representations into the LLM generation process through three novel mechanisms: a KG-conditioned attention layer that aligns token generation with entity and relation representations from a structured knowledge base; a dynamic knowledge retrieval controller that adaptively retrieves relevant KG subgraphs for each generation step; and a factual consistency verifier that evaluates generated claims against KG triples before output and triggers correction when factual inconsistency is detected. KILLM is evaluated on four knowledge-intensive generation benchmarks -- FEVER fact verification, Natural Questions open-domain QA, MedQA clinical QA, and SciFact scientific claim verification -- and compared against RAG, chain-of-thought prompting, and direct LLM baseline. KILLM achieves a 34.2% reduction in hallucination rate (SD = 3.8%) relative to direct LLM baseline and a 18.4% reduction relative to RAG, while maintaining 96.4% of baseline fluency as measured by human evaluation. The study contributes the KILLM architecture, a hallucination taxonomy for LLM generation, and an open-source evaluation toolkit for knowledge-grounded text generation benchmarking.
subject: Articles
  topic: section
subject: large language models
  topic: keywords
subject: hallucination
  topic: keywords
subject: knowledge graphs
  topic: keywords
subject: knowledge-grounded generation
  topic: keywords
subject: factual consistency
  topic: keywords
subject: retrieval-augmented generation
  topic: keywords
subject: reliable text generation
  topic: keywords
subject: knowledge integration
  topic: keywords
creator: Laura Garcia
creator: Andreas Nowak
creator: Laura Novak
rights: Copyright (c) 2024
date: 2024-03-22
publication date: 2024-03-22
starting page: 25
ending page: 32

Continual Learning Frameworks for Long-Lived Generative AI Systems
type: item
description: Generative AI systems deployed in production environments must evolve continuously as world knowledge changes, user needs shift, and deployment domains expand -- yet the dominant paradigm of train-once-deploy-forever treats trained models as static artefacts that cannot incorporate new information without full retraining. Continual learning for generative AI addresses this limitation by enabling models to accumulate new knowledge and capabilities over time while retaining previously learned information -- a challenge compounded for large language models by the catastrophic forgetting problem, the scale of model parameters, and the diversity of knowledge encoded in pre-trained representations. This paper proposes the Generative Continual Learning (GCL) framework, a structured methodology for designing and evaluating continual learning systems for long-lived LLMs, comprising four strategies: experience replay with importance-weighted memory, gradient episodic memory with task-boundary detection, modular architecture expansion with knowledge distillation, and retrieval-augmented knowledge integration. The GCL framework is evaluated through a longitudinal simulation study spanning 24 sequential knowledge update tasks across four knowledge domains -- factual world events, domain knowledge evolution, user preference adaptation, and capability expansion -- on LLaMA-2-7B as the base model. GCL strategies are benchmarked against naive sequential fine-tuning and full retraining baselines on five evaluation criteria: knowledge retention, knowledge integration, backward transfer, forward transfer, and compute efficiency. Results demonstrate that the modular expansion strategy achieves the best retention-integration balance (retention = 94.2%, integration = 87.6%) while retrieval- augmented integration achieves the highest compute efficiency. Gradient episodic memory with task-boundary detection most effectively prevents catastrophic forgetting (mean backward transfer = -0.8%). …
subject: Articles
  topic: section
subject: continual learning
  topic: keywords
subject: large language models
  topic: keywords
subject: catastrophic forgetting
  topic: keywords
subject: knowledge retention
  topic: keywords
subject: generative AI
  topic: keywords
subject: experience replay
  topic: keywords
subject: modular architecture
  topic: keywords
subject: retrieval-augmented generation
  topic: keywords
creator: Oscar Costa
creator: Ivan Schmidt
creator: Lea Costa
rights: Copyright (c) 2024
date: 2024-03-25
publication date: 2024-03-25
starting page: 17
ending page: 24

Efficient Fine-Tuning Strategies for Domain-Specific Large Language Models
type: item
description: Fine-tuning pre-trained large language models (LLMs) for domain-specific applications -- adapting general-purpose models to clinical, legal, financial, or scientific language domains -- is the primary practical methodology for deploying LLM capabilities in specialised contexts. The computational cost and data efficiency of fine-tuning are critical practical constraints: full fine-tuning of 7B-70B parameter models requires substantial compute and risks catastrophic forgetting of general capabilities, while naive instruction tuning on small domain datasets risks overfitting and poor out-of-distribution generalisation. This paper presents a systematic comparative evaluation of six parameter-efficient fine-tuning (PEFT) strategies -- LoRA, QLoRA, prefix tuning, prompt tuning, IA3, and full fine-tuning with selective layer unfreezing -- across four domain adaptation benchmarks: clinical NLP (MedQA), legal reasoning (LegalBench), financial analysis (FinBench), and scientific literature understanding (SciQ). Evaluation covers five criteria: domain task performance, general capability retention, training compute efficiency, memory efficiency, and catastrophic forgetting susceptibility. Results demonstrate that QLoRA achieves the best overall efficiency-performance profile: matching full fine-tuning domain performance within 2.1% on average while reducing training memory by 73.4% and training time by 61.8%. Domain-specific analysis reveals that the optimal PEFT strategy varies by domain: LoRA outperforms QLoRA in legal reasoning (precision-sensitive tasks), while prefix tuning achieves the lowest catastrophic forgetting in scientific NLP. The study contributes a systematic PEFT strategy evaluation benchmark, domain-specific fine-tuning recommendations, and an open-source fine-tuning toolkit implementing all six strategies on a unified codebase.
subject: Articles
  topic: section
subject: large language models
  topic: keywords
subject: fine-tuning
  topic: keywords
subject: parameter-efficient fine-tuning
  topic: keywords
subject: LoRA
  topic: keywords
subject: QLoRA
  topic: keywords
subject: domain adaptation
  topic: keywords
subject: catastrophic forgetting
  topic: keywords
subject: LLM benchmarking
  topic: keywords
creator: Laura Lindberg
creator: Erik Hansen
creator: Erik Ivanov
rights: Copyright (c) 2024
date: 2024-03-28
publication date: 2024-03-28
starting page: 9
ending page: 16

Generative Cognitive Agents in Zero-Shot Environments: Toward Continual Learning and Human-AI Co-Reasoning
type: item
description: Recent advances in generative artificial intelligence have enabled systems to reason, synthesize knowledge, and perform autonomous problem-solving without explicit task-specific training. Zero-shot learning, however, remains constrained by static knowledge boundaries, hallucinations, logical inconsistencies, and limited contextual adaptability. This study investigates the next phase of machine cognition: Generative Cognitive Agents (GCAs)—adaptive AI entities capable of performing reasoning, memory formation, contextual inference, skill composition, and interactive co-reasoning with humans in environments lacking prior task exposure. A novel framework termed CORE-G (Cognitive Reasoning Engine for Zero-Shot Generative Agents) is proposed to integrate episodic memory, dynamic knowledge scaffolding, neural-symbolic reasoning, real-time learning loops, and moral decision evaluators. Findings demonstrate that cognitive agents enhanced with continual learning pipelines outperform conventional zero-shot transformers by 71% higher reasoning reliability, 63% higher contextual adaptation, and 56% lower hallucination frequency. The paper concludes that the future of artificial reasoning lies not in larger static models, but in self-modifying cognitive intelligence capable of evolving alongside human collaborators.
subject: Articles
  topic: section
subject:
  topic: keywords
  value: Generative AI, Zero-Shot Learning, Continual Learning, Cognitive Agents, Human-AI Collaboration, Neural-Symbolic Reasoning, Co-Reasoning Systems, Adaptive Intelligence, Memory-Driven AI, Explainable AI.
creator: Dr. Jayashree G. C
rights: Copyright (c) 2025
date: 2025-11-07
publication date: 2025-11-07
starting page: 46
ending page: 56

Ethical Constraints in Generative Intelligence: Guardrails for Bias Control, Digital Safety, and
type: item
description: Generative Intelligence (GI) has rapidly evolved from simple pattern recognition to autonomous multimodal knowledge synthesis. While its applications revolutionize healthcare, finance, defense, law, and governance, its unconstrained deployment introduces ethical vulnerabilities—including bias amplification, identity exploitation, misinformation, autonomous harm, surveillance abuse, and cognitive manipulation. This paper constructs a unified ethical framework that embeds guardrails for bias suppression, safety governance, digital responsibility, algorithmic alignment, and autonomous restraint. It introduces G-SAFE architecture (Generative Safety, Accountability, Fairness, and Ethics)—a multilayer ethical control stack integrating bias auditing, synthetic content watermarking, adversarial containment, autonomy throttling, encrypted model decision tracing, and explainable reasoning paths. Empirical validations show that regulated GI systems trained with ethically bounded reward constraints reduce harmful output generation by 78%, implicit bias propagation by 64%, and hallucination frequency by 51%. The paper concludes by advocating for legally enforceable generative intelligence standards before full-scale autonomous adoption
subject: Articles
  topic: section
subject: Generative AI ethics, algorithmic bias, AI safety, autonomous AI governance, digital responsibility, misinformation control, AI regulation, trustworthy AI, cognitive guardrails, explainable AI.
  topic: keywords
creator: Dr. Muhammad Imran
rights: Copyright (c) 2025
date: 2025-11-07
publication date: 2025-11-07
starting page: 35
ending page: 45