Hi Muhammad,
It looks like you have a Java schema in your database, and sapinst is finding that and therefore assuming it's a double-stack system. Perhaps this system used to be double-stack at one time, and then was split? In the trace file I saw the following entries, at different points:
SID: HCT
DbServer: USALSQLT01\HCMT
DbName: HCT
ABAP Schema: hct
Java Schema: SAPHCTDB
TRACE 2014-04-18 09:26:36.318
Found corresponding java schema SAPHCPDB. Aborting.
TRACE 2014-04-18 09:26:36.333 [iaxxgenimp.cpp:325]
CGuiEngineImp::showDialogCalledByJs()
showing dlg d_doubleStackSystemError
TRACE 2014-04-18 09:26:36.333 [iaxxgenimp.cpp:335]
CGuiEngineImp::showDialogCalledByJs()
<dialog sid="d_doubleStackSystemError">
<title>Unsupported System</title>
<dialog/>
So, that seems to be the cause. If you're sure this is only supposed to be a single-stack ABAP system, you might try deleting the SAPHCPDB schema using database tools and then re-running sapinst.
While you're at it, it looks like you might have an old copy of Sun JRE 1.4.2 still installed (perhaps from the old days when that version was required to run sapinst). In the environment variables in the trace I saw:
JAVA_HOME=C:\j2sdk1.4.2_29-x64
You might want to uninstall that if you don't need it anymore, and unset that environment variable. Also, your swap size looks low for a 64-bit system with 8 GB RAM, even for a test system:
Swap size (MB): 9998.18
Best regards,
Matt