Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SYSVAD does not pass Certification Process #265

Open
vburel2018 opened this issue Jul 24, 2018 · 7 comments
Open

SYSVAD does not pass Certification Process #265

vburel2018 opened this issue Jul 24, 2018 · 7 comments

Comments

@vburel2018
Copy link

vburel2018 commented Jul 24, 2018

We recompiled yesterday a SYSVAD Audio Tablet Sample Driver with Latest Source Code 7/23/2018 version 10.41.14.806 and we installed it on our test machine: WIN10 PRO Build 17134.RS4 Release 180410-1804

Then we run HLK Studio (10.1.17134.17134) with Latest Test Filters installed and the following test failed:

-Audio Codec – AC3 Test – Certification – Desktop
-Audio Codec – Audio Logo Test – Glitch – Desktop
-Audio Codec – Class Driver Audio Logo Test – Certification – Desktop
-Audio Codec – KS Position Test
-Audio Codec – MFCaptureEngine API Test – Capture AMR-NB audio to a file from the default capture pin
-Audio Codec – MFCaptureEngine API Test – Capture PCM audio samples from the default capture pin
-Audio Codec – MFCaptureEngine API Test – Capture PCM audio to a wav file from the default capture pin

So the question is:
How are we expected to produce a certifiable audio driver if the Microsoft example cannot be certified ?

@vburel2018 vburel2018 changed the title SYSVAD does not pass Certification Process Failures... SYSVAD does not pass Certification Process Jul 24, 2018
@vburel2018
Copy link
Author

The following test could become successful on second pass, after having performed all other tests.
-Audio Codec – AC3 Test – Certification – Desktop
-Audio Codec – Class Driver Audio Logo Test – Certification – Desktop

The test below could also be successful for another reason
-Audio Codec – Audio Logo Test – Glitch – Desktop

Pending on installation process ? Different default audio format ? Or just a timing chance ?

@vburel2018
Copy link
Author

vburel2018 commented Jul 25, 2018

The result of the MFCaptureEngine API tests, seems to belong to the other drivers installed on the test machine... According test log, HLK performs test on all audio drivers present on the system (not only on SYSVAD): If i just let the Motherboard Realtek High Definition Audio driver, then these tests become successful:
-Audio Codec – MFCaptureEngine API Test – Capture AMR-NB audio to a file from the default capture pin
-Audio Codec – MFCaptureEngine API Test – Capture PCM audio to a wav file from the default capture pin

2 tests remain unsuccessful:
-Audio Codec – KS Position Test
-Audio Codec – MFCaptureEngine API Test – Capture PCM audio samples from the default capture pin

@mvaneerde
Copy link
Member

Please file a bug on http://aka.ms/Collaborate for each failing test, and attach to each bug an .hlkx with the failing test result.

@vburel2018
Copy link
Author

Do you have a link explaining what to do exactly with Collaborate ?

@mvaneerde
Copy link
Member

@vburel2018
Copy link
Author

Re-performing Certification tests on SYSVAD from the beginning, on fresh WIN10 installation and using devcon correctly is producing the following errors:

-Audio Codec – AC3 Test – Certification – Desktop

  • KS Pin Tests\KSCreatePin Multiple (SYSVAD wave HDMI)
  • KS Pin Tests\KSCreatePin Multiple (SYSVAD wave SPDIF)

-Audio Codec – Class Driver Audio Logo Test – Certification – Desktop

  • Glitch Testing\verify n-stream capture is glitch free (Internal Microphone Array Rear)
  • Glitch Testing\verify n-stream stressed capture is glitch free (Internal Microphone Array Front/Rear)
  • Glitch Testing\verify n-stream stressed capture is glitch free (External Microphone Headphone)
  • Glitch Testing\verify n-stream render is glitch free (SPDIF Interface)
  • Glitch Testing\verify n-stream stressed render is glitch free (SPDIF Interface)
  • Glitch Testing\verify n-stream stressed render is glitch free (Speakers)
  • Glitch Testing\verify n-stream render is glitch free (Headphone)
  • Glitch Testing\verify n-stream stressed render is glitch free (Headphone)
  • Glitch Testing\verify n-stream render is glitch free (SinkDescription Sample)

-Audio Codec – Communications Audio Fidelity Test (Manual) – Desktop

  • Cannot find Reference device with Loudspeaker and Microphone… (this test passed successfully on our previous certification test sessions)…

-Audio Codec – MFCaptureEngine API Test – Capture PCM audio samples from the default capture pin

  • no error notified in wtl file…

The second pass changed nothing (re-performing failed tests makes no change) except we got different error list for:

-Audio Codec – Class Driver Audio Logo Test – Certification – Desktop

  • Glitch Testing\verify n-stream capture is glitch free (Internal Microphone Array Front)
  • Glitch Testing\verify n-stream capture is glitch free (Internal Microphone Array Front/Rear)
  • Glitch Testing\verify n-stream capture is glitch free (External Microphone Headphone)
  • Glitch Testing\verify n-stream stressed capture is glitch free (External Microphone Headphone)
  • Glitch Testing\verify n-stream render is glitch free (SinkDescription Sample)
  • Glitch Testing\verify n-stream stressed render is glitch free (SinkDescription Sample)
  • Glitch Testing\verify n-stream render is glitch free (Speakers)
  • Glitch Testing\verify n-stream render is glitch free (Headphone)
  • Glitch Testing\verify n-stream stressed render is glitch free (Headphone)
  • Glitch Testing\verify n-stream render is glitch free (SPDIF Interface)
  • Glitch Testing\verify n-stream stressed render is glitch free (SPDIF Interface)

Does someone got the same experience ?

@darugeri
Copy link
Contributor

Hello,

For the tests you are mentioning I have the following remarks:

  • Audio Codec – AC3 Test – Certification – Desktop: This test is passing with current SysVAD,
  • Audio Codec – Class Driver Audio Logo Test – Certification – Desktop: Glitch testing was dropped and is no longer included in HLK,
  • Audio Codec – MFCaptureEngine API Test – Capture PCM audio samples from the default capture pin: I cannot find this test in the current HLK. Can you confirm the name and if it is still included in HLK?
  • Audio Codec – Communications Audio Fidelity Test (Manual) – Desktop: This test is not included in the audio playlist and it is not applicable on SysVAD since it depends on real hardware.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants