Helper.LoadPolicyLine causes poor performance

I’m loading nearly 10000 policies in my project . the Casbin core module and Adapter is injected as Scoped service. I found this method checking policy uniqueness every time when data line loaded. I wrote a method

private void PolicyUniquenization(Model model)
        {
            var m = model.Model;
            foreach(var key in m.Keys)
            {
                foreach (var ast in m[key].Values)
                {
                    ast.Policy = ast.Policy.Distinct().ToList();
                }
            }
        }

then alter Helper.LoadPolicyLine method without checking data uniqueness. and invoke at the end of LoadPolicy method in Adapter

public void LoadPolicy(Model.Model model)
        {
            // some codes of polices loading...

            PolicyUniquenization(model);
        }

seems to make things better? want to know if this modification causes any problem…

[sagilio]

They are Inherited from Object, So the Equals is equivalent to calling the ReferenceEquals method, I think we need to ensure the content is equal. And I think we can create a benchmark project which uses BenchmarkDotNet.

[xcaptain]

https://docs.microsoft.com/en-us/dotnet/api/system.collections.generic.list-1?view=netcore-3.1

List<string> already implemented GetHashCode and Equals