Your description reminds me of my grandmother’s baking! She also had a unique pie with a similar sound. She sometimes used plums. Can be both tart and sweet. Other times, it was apricot for her - they have a great tang. Check out some apricot custard recipes, might get you …