Migration to spring-boot 4+ and spring-batch 6+: job instance executor threads do not stop after jobOperator.stop(jobExecution)

[igorjava2025]

I attempted to migrate project from spring boot 3.1.1 to spring boot 4.0.0 and I encountered a problem with stopping a job instance correctly.
Expected: jobOperator.stop(jobExecution) will stop the execution of job instance work (after process current chunk).
Actual: jobOperator.stop(jobExecution) will update job execution db status (status STOPPED), but it will not stop job instance taskExecutor work (taskExecutor continue to see the jobExecution status as STARTED).

Can you give me some advice on how to fix this (best practice or example with correct work)?

Job configuration kotlin code for context:

@EnableBatchProcessing
@EnableJdbcJobRepository
class CommonBatchConfiguration {
    @Bean("batchTaskExecutor")
    fun batchTaskExecutor(): AsyncTaskExecutor {
        val batchTaskExecutor = ThreadPoolTaskExecutor()
        batchTaskExecutor.corePoolSize = 5
        batchTaskExecutor.maxPoolSize = 5
        batchTaskExecutor.queueCapacity = 0
        batchTaskExecutor.setRejectedExecutionHandler(ThreadPoolExecutor.CallerRunsPolicy())
        batchTaskExecutor.setThreadNamePrefix("batch-")
        batchTaskExecutor.setWaitForTasksToCompleteOnShutdown(true)
        batchTaskExecutor.initialize()
        return batchTaskExecutor
    }
}

@Configuration
@Import(CommonBatchConfiguration::class)
class BusinessTaskJobConfig(private val jobRepository: JobRepository) {
    @Bean("businessTaskJob")
    fun businessTaskJob(
        @Qualifier("businessTaskStep") step: Step,
    ): Job =
        JobBuilder("businessTaskJob", jobRepository)
            .preventRestart()
            .flow(step)
            .end()
            .build()

    @Bean("businessTaskStep")
    fun businessTaskStep(
        @Qualifier("businessTaskStepItemReader") reader: ItemReader<IdType>,
        @Qualifier("businessTaskStepItemProcessor") itemProcessor: FunctionItemProcessor<IdType, DataType>,
        @Qualifier("businessTaskStepItemWriter") itemWriter: ItemWriter<DataType>,
        @Qualifier("batchTaskExecutor") batchTaskExecutor: AsyncTaskExecutor,
        transactionManager: PlatformTransactionManager,
    ): Step =
        StepBuilder("businessTaskStep", jobRepository)
            .chunk<IdType, DataType>(100)
            .transactionManager(transactionManager)
            .reader(reader)
            .processor(itemProcessor)
            .writer(itemWriter)
            .taskExecutor(batchTaskExecutor)
            .build()

    @Bean("businessTaskStepItemReader")
    @StepScope
    fun reader(
        @Value("#{jobParameters['requestDataForItemReader']}") requestDataForItemReader: String?,
    ): ItemReader<IdType> = createItemReader(requestDataForItemReader)

    @Bean("businessTaskStepItemProcessor")
    fun itemProcessor(): FunctionItemProcessor<IdType, DataType> = createItemProcessor()

    @Bean("businessTaskStepItemWriter")
    fun itemWriter(): ItemWriter<DataType> = createItemWriter()
}

[fmbenhassine]

This is reported here #5114. The fix is planned for the upcoming 6.0.1. Thank you for reporting it here anyway.