You can directly upgrade to Test Data Management 10.4.1 from 10.4.0.
Run the Informatica service installer to apply the hotfix on Test Data Management and services within an Informatica domain. Complete the pre-upgrade tasks before you apply the hotfix. After you apply the hotfix, upgrade the required services and complete post upgrade tasks to complete the Test Data Management upgrade.