Most wanted topic in SEO category, because every second Seo expert recommend sitemap. Do we need sitemap anymore. Interesting question but the actual fact is that, Google do not rely on sitemap and it is ugly truth.
If you do not believe on my voice then try itself, create a simple website and do not create or associate any sitemap with it even do not submit sitemap to any search engine. Then you will see implements, that search engine crawler crawling your web pages sequentially.
Google just need a reliable website with fast loading speed pages. Additional plugins will create clutter on your website, which also reduce web page speed, which is uncertainty.
There is no problem and issue with you, if you are using sitemap for your website. This post is just to create to highlight the purpose, what is more important step than Sitemap. Your website should be super fast and trustworthy.