AWS Parameter Store - Loading and Processing Sequence of Operations

[benjamin-stern]

AWS Parameter Store - Loading and Processing Sequence of Operations

[ashishdhingra]

Hi @benjstern,

Good afternoon.

Thanks for posting guidance question. The Amazon.Extensions.Configuration.SystemsManager extends the Microsoft's configuration system by extending the interfaces such as IConfigurationBuilder interface. The AddSystemsManager adds the SystemsManagerConfigurationSource (derived from IConfigurationSource) to the IConfigurationBuilder. When the configuration is built, the configuration source(s) are queried one by one to fetch the parameters from the configuration sources. With it SystemsManagerConfigurationSource, it retrieves the parameters using GetParametersByPathAsync or GetParameterAsync. SystemsManagerProcessor. GetDataAsync() determines whether to get a particular parameter or get parameters by path.

For more details on how Microsoft's configuration system works, please refer Configuration in ASP.NET Core. This provides good overview of built in configuration providers and how custom configuration provider(s) work.

Hope this helps.

Thanks,
Ashish

[benjamin-stern]

Thank you @ashishdhingra ,

Correct me if I am wrong, but SystemsManagerProcessor.GetDataAsync() seems to indicate that if it's evaluated as a path contained in the AWS Secret Manager then it would query them one by one.

But even as an AWS Parameter Store value, there could be multiple queries with each internally calling AmazonSimpleSystemsManagementClient.GetParametersByPathAsync (GetParametersByPathRequest, CancellationToken) so if an exception is thrown no processing will occur even if there were multiple requests made due to the provided NextToken.

Though as far as I can tell there is no way of knowing what the default Max Results are, could be anything.

Is there any event we can latch onto at the beginning of the processing of the data?

[ashishdhingra]

Thank you @ashishdhingra ,

Correct me if I am wrong, but SystemsManagerProcessor.GetDataAsync() seems to indicate that if it's evaluated as a path contained in the AWS Secret Manager then it would query them one by one.

But even as an AWS Parameter Store value, there could be multiple queries with each internally calling AmazonSimpleSystemsManagementClient.GetParametersByPathAsync (GetParametersByPathRequest, CancellationToken) so if an exception is thrown no processing will occur even if there were multiple requests made due to the provided NextToken.

Though as far as I can tell there is no way of knowing what the default Max Results are, could be anything.

Is there any event we can latch onto at the beginning of the processing of the data?

@benjstern Yes you are correct. If the exception occurs, then as per

aws-dotnet-extensions-configuration/src/Amazon.Extensions.Configuration.SystemsManager/Internal/SystemsManagerProcessor.cs

Line 48 in 0302f71

private async Task<IDictionary<string, string>> GetParametersByPathAsync()

, the request will fail.

If you refer, the BeforeRequestEvent is fired via assignment impl.BeforeRequestEvent += ServiceClientAppender.ServiceClientBeforeRequestEvent. I'm not sure if you could latch on to event at the beginning of the request.

[benjamin-stern]

Thanks for your prompt replies and assistance, it is greatly appreciated.

[github-actions]

⚠️COMMENT VISIBILITY WARNING⚠️

Comments on closed issues are hard for our team to see.
If you need more assistance, please either tag a team member or open a new issue that references this one.
If you wish to keep having a conversation with other community members under this issue feel free to do so.